-- Logs begin at Tue 2022-05-10 18:58:24 UTC, end at Tue 2022-05-10 20:15:45 UTC. -- May 10 19:41:30.719624 dv-cinder-841315-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 19:41:30.729167 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 19:41:30 2022] *** May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: nodename: dv-cinder-841315-1-iscsi May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: machine: x86_64 May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: clock source: unix May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: pcre jit disabled May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: detected number of CPU cores: 4 May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: current working directory: / May 10 19:41:30.731823 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: detected binary path: /usr/bin/uwsgi-core May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: your processes number limit is 47680 May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: your memory page size is 4096 bytes May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: detected max file descriptor number: 2048 May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: lock engine: pthread robust mutexes May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: thunder lock: enabled May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 19:41:30.732380 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 19:41:30.777715 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: Python main interpreter initialized at 0x55efbf6749c0 May 10 19:41:30.777715 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: python threads support enabled May 10 19:41:30.777715 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: your server socket listen backlog is limited to 100 connections May 10 19:41:30.777715 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: your mercy for graceful operations on workers is 90 seconds May 10 19:41:30.778038 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: mapped 403077 bytes (393 KB) for 2 cores May 10 19:41:30.778038 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: *** Operational MODE: preforking *** May 10 19:41:30.778334 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: *** uWSGI is running in multiple interpreter mode *** May 10 19:41:30.778334 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: spawned uWSGI master process (pid: 79886) May 10 19:41:30.778561 dv-cinder-841315-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 19:41:30.786492 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: spawned uWSGI worker 1 (pid: 79896, cores: 1) May 10 19:41:30.786492 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: spawned uWSGI worker 2 (pid: 79897, cores: 1) May 10 19:41:30.786492 dv-cinder-841315-1-iscsi devstack@keystone.service[79886]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 19:41:36.495753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:41:36.495753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: from cryptography.utils import int_from_bytes May 10 19:41:36.497101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:41:36.497101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: from cryptography.utils import int_from_bytes May 10 19:41:36.546842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:41:36.547047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:41:36.547221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] command line args: [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:41:36.547488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:41:36.547664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ================================================================================ {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:41:36.547917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] admin_token = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.548160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] config_dir = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.548345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.548525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] config_source = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.548702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] debug = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.548900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_config_append = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.550981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.551413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_dir = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.551413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_file = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.551516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.551800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.551906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.552173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.552356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.552551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.552746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.553010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.553262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.553562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.553808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.554043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.554292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.554572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.554852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.555327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.555524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] publish_errors = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.555744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.555985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.556189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.556375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.556614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.556829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] standard_threads = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] use_journal = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] use_json = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.557986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] use_stderr = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.558155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] use_syslog = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.558378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.558661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.558901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.559163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.559402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.559652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.559890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.560141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.560379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.560628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.560874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.561124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.561358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.561605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.561842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.562091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.562341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.562601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.562859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.563115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.563361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.563597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.563850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.564111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.564362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.564610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.564841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.565071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.565299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.565540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.565789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.566037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.566267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.566542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.566769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.567018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.567255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.567504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.567734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.567967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.568202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.568432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.568689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.568922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.569153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.569389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.569639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.569872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.570109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.570339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.570599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.570835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.571084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.571315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.571552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.571790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.572025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.572261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.572495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.572725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.572972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.573206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.573443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.573674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.573932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.574170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.574403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.574668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.574903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.575171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.575409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.575667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.575913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.576051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:41:36.576051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: from cryptography.utils import int_from_bytes May 10 19:41:36.576639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.576639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.576888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 19:41:36.576888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: from cryptography.utils import int_from_bytes May 10 19:41:36.577130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.577130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.577368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.577493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.577640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.577878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.578115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.578352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.578613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.578851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.579114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.579356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.579597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.579837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.580082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.580322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.580562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.580801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.581035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.581266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.581498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.581737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.581967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.582211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.582449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.582719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.582961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.583220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.583483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.583729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.583963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.external = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.584718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.585030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.585266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.585505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.password = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.585738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] auth.token = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.585981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.586221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.586569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.586708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.586960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.587211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.587445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.587682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.587928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.588180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.588429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.588667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.588912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.589146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.589415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.589673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.589912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.590166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.590451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.590718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.590982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.591225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.591483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.591721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.591958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.592204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.592449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.592680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.592929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.593167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.593420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.593668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.593909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.594149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.594398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.594661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.594911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.596270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.596270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.596270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.596270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.596270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.597214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.597214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.597214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.597214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.597214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.598885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.599434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.599434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.599827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.599827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.600820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.600820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.601232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.601431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.601603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.601774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.601947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.602199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.602435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.602703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.602950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.603182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.603420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.603649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.603886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.604121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.604361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.604597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.604832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.605081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.605329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.605564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.605793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.606041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.606288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.606544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.606782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.607043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.607469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.607469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.607727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.607950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.608198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.608446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.608694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.608931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.609162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.609396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.609632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.609868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.610098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.610345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.610617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.610865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.611113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.611930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.611930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.611930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.612146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.612300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.612511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.612783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.612982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.613235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.613468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.613733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.613959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.614223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.614441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.614698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.614936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.615332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.615749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.616141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.616384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.616628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.616883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.617134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.617431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.617621 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.617875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.618113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] role.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] role.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.621871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.622215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.622548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.622700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.623060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.623299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.623553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.623803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.624053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.624305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.624504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 19:41:36.624646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.624777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 19:41:36.624915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.625058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] command line args: [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 19:41:36.625197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.625599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 19:41:36.625732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.625863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ================================================================================ {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 19:41:36.626002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.626141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] admin_token = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.626272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.626401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] config_dir = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.626558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.626692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.626692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] config_source = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.626950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.627089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] debug = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.627222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.627358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.627534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.627672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.627672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.627917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.627917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.628160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.628300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.628430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.628560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.628700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.628700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_config_append = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.628959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.629096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.629228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.629358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_dir = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.629358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_file = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.629602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.629739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.629869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.629869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.630115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.630244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.630382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.630573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.630709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.630843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.630973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.630973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.631263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.631403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.631535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.631664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.631795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.631924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.632053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.632205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.632337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.632468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.632604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.632735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.632863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.633001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.633132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.633268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.633399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.633536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.633668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.connection = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.633668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.634019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.634160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.634291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] publish_errors = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.634421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.634590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.634723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.634853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.634853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.635097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.635225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.635363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.635493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.635623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.635752 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] standard_threads = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.635890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.636020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.636157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.636288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.636418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.636553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.636685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.636814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] use_journal = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.636814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] use_json = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.637067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.637197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] use_stderr = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.637326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.637455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] use_syslog = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.637584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.637737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 19:41:36.637869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.637999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.638994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.639130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.640204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.641826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.642058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.642296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.642571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.642825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.643057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.643289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.643538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.643789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.644030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.644283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.644516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.644755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.644992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.645222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.645454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.645685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.645916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.646156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.646407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.646700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.647457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.647692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.647931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.648171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.648423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.648654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.648893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.649134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.649373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.649610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.649849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.650080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.650330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.650650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.650893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.651128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.651393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.651631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.651865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.652104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.652342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.652614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.652856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.653108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.653369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.653610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.653851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.654089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.654341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.654633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.654877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.655122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.655414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.655659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.655901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.656140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.656378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.656646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.656889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.657134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.657373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.657618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.657858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.658111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.658568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.659008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.659452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.659887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.660332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.660748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.661010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.661258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.661518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.661765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.662030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.662297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.663157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.663386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.external = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.663607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.663919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.664174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.664394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.password = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.664605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] auth.token = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.664824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.665063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.665312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.665546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.665798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.666050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.666407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.666898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.667369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.667839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.668322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.668787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.669253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.669638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.669923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.670192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.670445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.670747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.671057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.671313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.671450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.671670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.671805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.671934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.672067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.672198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.672343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.672534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.672787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.673040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.673274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.673533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.673771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.674019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.674256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.674569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.674802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.675059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.675302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.675524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.675782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.676029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.676250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.676509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.676744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.676988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.677244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.677502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.677738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.677996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.678237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.684266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.685450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.686768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.686900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.687092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.688251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.689406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.690408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.690408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.690408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.690408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.690893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.696360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.696637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.696928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.697308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.697519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.697792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.698044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.698313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.698787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.698937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.699143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.699394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.699656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.699919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.700167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.700433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.700673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.700926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.701171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.701416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.701661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.701916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.702169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.702407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.702675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.702923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.703182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.703437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.703679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.703937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.704195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.704450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.704708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.704953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.705200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.705443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] role.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.705700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] role.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.705941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.706197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.706451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.706757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.707013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.707268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.707522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.707774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.708028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.708455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.708603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.708758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.709013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.709804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.710248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.710542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.710768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.711024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.711279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.711534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.711774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.712036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.712296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.712541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.712778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.713014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.713250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.713506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.713740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.713895 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.714033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.714171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.714171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.714579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.714715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.714943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.715185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.715440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.715682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.715949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.716202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.716444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.716693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.716940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.717191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.717432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.717674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.717912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.718163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.718417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.718684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.718933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.719236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.719505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.connection = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.719766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.720021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.720264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.720511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.720751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.720992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.721233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.721475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.721725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.721967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.722214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.722452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.722724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.722965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.723215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.723450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.723695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.723934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 19:41:36.724108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 19:41:36.752208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.752414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.752597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.762050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.768780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.780923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.781157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.821227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.821449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.821594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.858351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.858605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.892535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.892885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.893216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.893544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.893870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.894205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.904885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.905116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.905340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.905559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.905784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.906002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.919507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.919860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.920195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.920540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.920867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.921191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.921519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.922130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.922365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.922620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.922848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.923073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.923292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.923509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.933921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.934207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.947704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.947993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.948225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.948446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.948660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.948873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.949089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79896) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.950524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.950924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.951239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.951574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.951867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.952155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.952442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 19:41:36.967139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.967353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:41:36.967519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.967694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.967861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:41:36.967991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:41:36.968151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.968384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.968520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.968658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.968783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 19:41:36.969081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.969209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.969468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.969791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.970111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.980020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.980295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.980567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.980847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.981803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.982146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.982493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.982843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.989013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:36.991169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:36.992487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:36.992770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.993054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.993338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.993620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.993878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.994145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.994418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.994712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.994986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.995227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:36.995360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.995622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.995987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.996442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.996793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.997118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.997452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.997790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.998124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.998483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:36.998819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.023117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.024695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.024977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.027266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.028961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.029356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.030282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.030587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.030871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.034990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.035338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.035687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.038853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.039134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.043666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.043950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.044152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.044280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.044501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.044627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.044767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.045036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.045304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.045568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.049584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.049944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.050291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.050657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.051000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.051341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.051679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.052016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.067444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.067738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.072413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.072772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.072927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.076614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.076927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.077689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.081552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.081943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.082133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.086606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.087945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.090361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.090697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.090983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.091268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.091548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.091840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.092125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.096078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.096454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.096807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.097160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.097508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.097856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.111446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.111768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.112041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.112305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.118114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.118636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.118982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.119318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.120527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.122297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.122588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.125899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.126179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.126482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.126797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.128060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.128543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.129907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.130239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.133905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.134263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.134628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.134975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.135307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.142453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.142755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.143037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.143320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.143602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.143876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.144170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.149751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.150095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.150439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.150809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.151153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.151491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.151851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.162742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.166032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.169408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.170259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.171042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.172688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.173090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.173392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.173934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.177329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.179551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.181272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.181520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.181674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.182025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.183182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.186405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.186722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.187009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.187285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.189847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.191668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.195556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.195920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.196268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.196609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.197124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.197419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.197702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.205600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79896) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.205881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.206161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.206251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.206447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.206671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.206763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.207010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.207100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.207290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.207556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.207821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.208101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.208480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.208757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.209040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.209329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79896) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.216273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 19:41:37.216627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.216980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.217323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.217662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.218017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.218358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.218721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.219060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.219410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.219747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.220087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.220417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.220749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 19:41:37.247653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55efbf6749c0 pid: 79896 (default app) May 10 19:41:37.251397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39e02-81f8-451c-8bb4-c391434b9dbc None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:37.251700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39e02-81f8-451c-8bb4-c391434b9dbc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:37.251979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d39e02-81f8-451c-8bb4-c391434b9dbc None None] PATH_INFO: `/v3` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:37.259112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue May 10 19:41:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:37.261325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55efbf6749c0 pid: 79897 (default app) May 10 19:41:45.228770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:45.229334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:45.229334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:45.230673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:45.238007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:45.238440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:45.238592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:45.269930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG oslo_db.sqlalchemy.engines [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:41:45.459022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG passlib.handlers.bcrypt [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79897) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 19:41:45.459483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG passlib.handlers.bcrypt [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79897) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 19:41:45.516188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:45.517701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:45.641622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 19:41:45.698484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:45.734580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG oslo_db.sqlalchemy.engines [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 19:41:45.863480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d133fb8-786d-423b-9c13-c8e117aa5003 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:45.867728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:45.868397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:45.868686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:45.868968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:45.877479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:45.928250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 19:41:45.928594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4246a23-f3f7-4010-9399-c954c17d3fb8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:45.937942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue May 10 19:41:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:41:45.944247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:45.958286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cd2cf-89f7-4f60-b00c-2bc91c154413 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:45.963232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:45.964376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:45.964667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:45.964956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] PATH_INFO: `/v3/projects/f00ba0ca569547899fe0f1c352883756` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:45.966522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] RBAC: Authorizing `identity:get_project(project_id=f00ba0ca569547899fe0f1c352883756)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:46.017114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING keystone.common.rbac_enforcer.enforcer [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 19:41:46.017457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c84a6-f1cd-45e0-ba09-831177e9ca9a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:46.022596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue May 10 19:41:45 2022] GET /identity/v3/projects/f00ba0ca569547899fe0f1c352883756 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:48.234789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8c90-48d9-4a16-a6b2-f80a6452b72b None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:48.235331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8c90-48d9-4a16-a6b2-f80a6452b72b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:48.235331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf8c90-48d9-4a16-a6b2-f80a6452b72b None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:48.239448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:48.244969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:48.245387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:48.245529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:48.265835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:48.267391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:48.276047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 19:41:48.298803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8c90-48d9-4a16-a6b2-f80a6452b72b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:48.310615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf8c90-48d9-4a16-a6b2-f80a6452b72b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:48.314780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:48.315402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:48.315686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:48.315961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:48.323990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:48.325754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78a85e-0ff9-42d8-a231-201f83e15722 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:48.334828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue May 10 19:41:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:41:48.340038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:48.348769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee6d18-2c1a-420e-a229-75dd9add2c8e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:48.353666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:48.354544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:48.354829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:48.355106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:48.356836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:48.358690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce0f57-c168-4fa9-8f2a-cd5e6e555a84 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:48.360233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue May 10 19:41:48 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:50.633288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598daa2-1b21-4ff2-a378-a0b5c31250e7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:50.633850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598daa2-1b21-4ff2-a378-a0b5c31250e7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:50.633850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598daa2-1b21-4ff2-a378-a0b5c31250e7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:50.635213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:41:50.640272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:50.640697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:50.640911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:50.645052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eacea3-4d35-4ff2-bd77-d97f953ee4f0 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:50.645336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eacea3-4d35-4ff2-bd77-d97f953ee4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:50.645610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eacea3-4d35-4ff2-bd77-d97f953ee4f0 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:50.647613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:50.652704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:50.652984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:50.653262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:50.695747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG passlib.handlers.bcrypt [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79896) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 19:41:50.696174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG passlib.handlers.bcrypt [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79896) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 19:41:50.744170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:50.745794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:50.766213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:50.767442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:50.845639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:41:50.853867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:50.868943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:50.875252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:50.965194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276afc15-f3dd-4627-84a7-1b410f1f4dd9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:50.971643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944a1e-ea70-4f74-8e55-f5b465162163 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:50.997323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:50.998113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:50.998393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:50.998695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.004153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.005046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.005345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.005628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.009881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:41:51.021089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:41:51.022854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:41:51.023801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:41:51.028431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.073122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.074675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.122076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698070-431e-4eb0-abb5-8f46d9817215 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.154258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.154959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.155242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.155517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.156268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:51.156574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.157957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.166485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:41:51.174387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 7/16] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:51.174562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.175366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.268790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fda-9232-4c34-94b2-94df0c1d20de None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.269649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb76d6-7afb-43c2-af41-82267ccbb8a1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.300851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.301694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.301985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.302268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.302832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.304200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.304484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.304760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.305963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.307479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.309103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:51.314520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.320978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.322476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:41:51.342760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:41:51.343624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:41:51.344431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:41:51.344431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:41:51.344431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:41:51.344431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:41:51.344431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:41:51.350199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.409280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d8ca6-c99f-4719-b373-e1d55b682c32 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.441374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.442160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.442447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.442751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.443952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.444551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3d6c-5d9f-496a-8607-e1e29e62028d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.445386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.447171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:51.452761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:51.477373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.478043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.478333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.478658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.479387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:51.479695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.481089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3417a5-793f-4a6c-9fcc-43a40d47770d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.498269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:51.551577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863bffb-7bf8-4c72-bdb0-99f39eb7d026 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:51.587680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:51.588358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:51.588649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:51.588929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:51.589783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.domain.id=default, user.id=88a33ed416d14d68b26b32e116862838) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:51.590097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:51.591608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f7358-c03e-4425-a02b-7c3301184d4b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:51.600800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1322 bytes} [Tue May 10 19:41:51 2022] GET /identity/v3/role_assignments?user.id=88a33ed416d14d68b26b32e116862838&scope.domain.id=default&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:54.131674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d5b0-0d1d-4fff-8e7f-ef3b5de2c9f7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.132568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d5b0-0d1d-4fff-8e7f-ef3b5de2c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.133018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d5b0-0d1d-4fff-8e7f-ef3b5de2c9f7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.134595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:41:54.139948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.140741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.141194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.163207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:54.164692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:54.220465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a05e-b292-47b0-bf0a-ea67c536944a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.221099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a05e-b292-47b0-bf0a-ea67c536944a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.221579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a05e-b292-47b0-bf0a-ea67c536944a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.225231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 13/23] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:41:54.229614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.230157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.230670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.250852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:41:54.256082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:54.257281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:54.280721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:54.351196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:54.386944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:54.429445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef192852-a7c5-40a8-8e89-af0e6814de65 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:54.489852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:54.490976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.491260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.491533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.492282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:54.493688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813da67-53e8-4a78-93cd-e9c69f969cef None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:54.517656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fd450-e5c9-4852-8a9d-e7fc77796299 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:54.557524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:54.558811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.561398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.561989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.587379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:54.588886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:41:54.617453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:41:54.618346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:41:54.619193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:41:54.619193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:41:54.619193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:41:54.619193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:41:54.627116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 15/26] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:41:54.632739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:54.661403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 12/27] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 19:41:54 2022] POST /identity/v3/roles => generated 219 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:41:54.680013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4ae4-8a18-43d8-9c92-f9f369deb4ff None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.680662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4ae4-8a18-43d8-9c92-f9f369deb4ff None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.681144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c4ae4-8a18-43d8-9c92-f9f369deb4ff None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.682858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 13/28] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:54.696568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.697194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.697704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.728065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:54.729969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:54.758440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fcc59-3348-487d-832a-c82d582436e1 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:54.804472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:54.805449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:54.805870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:54.806284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:54.807207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:54.807642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:54.809210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:54.825539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 14/29] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:41:54.836492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 16/30] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:54.842488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:54.865946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:54.970236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a9979-bf41-41b9-9b88-ba5468ba0735 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.008639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.009320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.009900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.010187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.010940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.012555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0091-80a4-455b-b7c4-c9bfa21de179 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.034594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc075d-3d6a-4212-bda7-6162b49d2c7d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.050232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 15/31] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:41:54 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:41:55.052240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674286-5c3f-4958-b036-7dcba111b0dd None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.052847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674286-5c3f-4958-b036-7dcba111b0dd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.053844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674286-5c3f-4958-b036-7dcba111b0dd None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.056052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 16/32] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:41:55.061457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.062142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.062882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.086296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:55.087887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:55.111278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.112106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.112396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.112681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.144455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:41:55.167514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:41:55.168663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:55.169605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:41:55.171977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 17/33] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:41:55.179060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.195036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 17/34] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:55.232172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.330496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559513-b129-4ea5-a557-c9b56988586f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.361641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0f448-9449-40fb-aa28-fdabe88d3dd1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.365950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.366722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.367099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.367494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.368347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:55.368748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.370226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.383353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:55.389434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.403380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.404367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.404862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.405288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.406244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.407895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.427027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 19:41:55 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:41:55.618886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab17f28-4c35-4670-a0d4-62083cd810ea None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.660377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.661262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.661544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.661821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.664107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.665564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287dc5-e5f2-4ea5-afa4-b1eea0c15756 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.667267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 19/37] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:41:55 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:55.673616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.675231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15145-79fd-4df2-bd82-daacf05594f7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.675527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15145-79fd-4df2-bd82-daacf05594f7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.675810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15145-79fd-4df2-bd82-daacf05594f7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.677298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 20/38] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:55.682265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.682878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.683291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.704662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:55.706182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:55.787675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 21/39] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:55.787839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007c20-3ac3-4423-94d0-929da59fbd12 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.809286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.824475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.825298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.825600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.825875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.827135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.828744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.831659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 19/40] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:55.837997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:55.911533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308323c2-1eae-438e-8f1a-33849d21a14d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.939846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06543c98-96f7-4fd5-9c00-75c2d6be049e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:55.945436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.946106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.946390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.946697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.947442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.948825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.973245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:55.974121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:55.974410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:55.974756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] PATH_INFO: `/v3/domains/default/users/88a33ed416d14d68b26b32e116862838/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:55.976828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=88a33ed416d14d68b26b32e116862838, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:55.978268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff0e80-686f-433a-9141-103b4b9e0832 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:55.993002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 20/41] 10.222.0.57 () {58 vars in 1361 bytes} [Tue May 10 19:41:55 2022] PUT /identity/v3/domains/default/users/88a33ed416d14d68b26b32e116862838/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:41:56.064981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586cbe-1265-410d-accd-65b9bb384802 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:56.065267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586cbe-1265-410d-accd-65b9bb384802 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:56.065486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89586cbe-1265-410d-accd-65b9bb384802 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:56.067115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 21/42] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:56.071711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 22/43] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 19:41:55 2022] POST /identity/v3/roles => generated 223 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:41:56.073200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:56.073508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:56.073791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:56.092130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:56.093443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:56.179746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 22/44] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:41:56.204949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:56.308240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858edbcf-b81e-4144-9d7c-a8c04abecb42 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:56.341029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:56.341755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:56.342038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:56.342314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:56.343581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:56.345139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7ca30-f48f-42a5-8acd-83fa44c97d39 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:56.346795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 23/45] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:56.352842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:56.447690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6ad3-fc93-4c6a-aeda-175747ddb175 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:56.479798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:56.480460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:56.480749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:56.481030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:56.481750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:56.483247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c6822-553f-4ccc-84fe-a67c2c3002b4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:56.508648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:41:56 2022] POST /identity/v3/projects => generated 312 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:41:58.228176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3f93-6230-431b-a292-083aa2271a1a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.228694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3f93-6230-431b-a292-083aa2271a1a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.228802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3f93-6230-431b-a292-083aa2271a1a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.230128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:41:58.235589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.236009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.236276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.253328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:58.254528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:58.318948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:58.341282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3f93-6230-431b-a292-083aa2271a1a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.438865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3f93-6230-431b-a292-083aa2271a1a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:58.471667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:58.472459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.472751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.473030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.482914 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:41:58.490957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:41:58.491926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:41:58.492837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 25/49] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:41:58.497872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.597726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263ba3f-70f8-474d-b16d-e8bc20a9dc5c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:58.629328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:58.629997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.630284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.630596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.631917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:58.632229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:58.633629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c34d7-d019-40e3-b2f6-899d5bf59c37 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:58.641449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:58.647589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.718537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172526c-776c-4c71-8a62-9d78c444582a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.718830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172526c-776c-4c71-8a62-9d78c444582a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.719115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172526c-776c-4c71-8a62-9d78c444582a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.720497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 26/51] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:41:58.725563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.725860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.726136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.742080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:41:58.742880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee37c6-2bce-49a1-982a-533b27fdbbb9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:58.743233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:41:58.775339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:58.776198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.776490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.776760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.778045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:58.779522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:58.781140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:41:58.786379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.807256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 27/53] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:41:58.835150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.880691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507177ed-42f8-49ee-b905-8cf2cfe06c6e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:58.913375 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:58.914162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.914473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.914759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.915930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:58.917383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:58.919022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:58.924558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:58.928975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da8ed-46fc-42d9-b808-d41e7365002d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:58.961202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:58.961992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:58.962282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:58.962600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:58.963790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:58.965252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:58.966915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:58.972292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:41:59.018110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cd784-8f77-4ab3-9c07-528b1b969924 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:59.049523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:59.050170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:59.050480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:59.050765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:59.051615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.domain.id=default, user.id=88a33ed416d14d68b26b32e116862838) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:41:59.051929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:59.053972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea087-7d27-4440-b65d-8ca18fe929ef None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:59.062396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1322 bytes} [Tue May 10 19:41:58 2022] GET /identity/v3/role_assignments?user.id=88a33ed416d14d68b26b32e116862838&scope.domain.id=default&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:41:59.065531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554f428-fd96-4819-8e66-7015e101e937 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:41:59.100917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:41:59.101601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:41:59.101891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:41:59.102174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:41:59.102946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:41:59.104438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee8b23-cdeb-4798-9183-7fe7ba29000c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:41:59.132571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 29/57] 10.222.0.57 () {60 vars in 1140 bytes} [Tue May 10 19:41:58 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:42:01.373230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0efb-695f-4c32-927f-4943f7446a0b None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:01.373743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0efb-695f-4c32-927f-4943f7446a0b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:01.373827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0efb-695f-4c32-927f-4943f7446a0b None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:01.375200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:01.380722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:01.381583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:01.381861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:01.398047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:01.399272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:01.461546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:01.485139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0efb-695f-4c32-927f-4943f7446a0b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:01.583837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0efb-695f-4c32-927f-4943f7446a0b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:01.615005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:01.616335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:01.616619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:01.616894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:01.618062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:01.619543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d48020-de27-49df-be3a-85d866e8737c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:01.621135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:01.627040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:01.718301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291476ee-46fd-4845-b9aa-817ff59a83b2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:01.750193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:01.751137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:01.751424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:01.751702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:01.752419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:01.753861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8a3d-84ee-4dd4-ae26-574236890c38 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:01.777915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:01 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:42:05.197916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998623-e44c-4ca2-8e95-bcf243ff69fa None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.198891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998623-e44c-4ca2-8e95-bcf243ff69fa None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.199376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998623-e44c-4ca2-8e95-bcf243ff69fa None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.200954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:05.206550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.207408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.207873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.231495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:05.232986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:05.256342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd218a-3b25-43c1-91a6-7e146bda2029 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.256958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd218a-3b25-43c1-91a6-7e146bda2029 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.257445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd218a-3b25-43c1-91a6-7e146bda2029 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.259355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:05.291359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.291975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.292456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.321664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 32/64] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:05.321903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:05.324664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:05.361032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.420846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:05.461852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.466096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0e901-cdff-45d7-b348-315c39b0c312 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:05.512129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:05.512945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.513231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.513509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.543552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-4bc0132e-b4e1-48a0-8434-5de38409dbe7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:05.551335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:05.552225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:05.554080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 33/66] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:05.555383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb31fb-8805-4c4d-a4f7-bed556b00818 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.555383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb31fb-8805-4c4d-a4f7-bed556b00818 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.555383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb31fb-8805-4c4d-a4f7-bed556b00818 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.556660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 34/67] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:05.557961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13eca-9636-42c5-93b0-19c7893bf867 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.558532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13eca-9636-42c5-93b0-19c7893bf867 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.559001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb13eca-9636-42c5-93b0-19c7893bf867 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.560390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 35/68] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:05.561290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb13eca-9636-42c5-93b0-19c7893bf867 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.583515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c46411-ba95-4e1c-85c9-bbcce43037bf None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:05.625340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:05.626431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.626756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.627045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.639321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a4ebfbd7-cf62-4059-9537-3c33610ca050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:05.647776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:05.648771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:05.649526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:05.650789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.650789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.651013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.667831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:05.669034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:05.673892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb13eca-9636-42c5-93b0-19c7893bf867 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:05.710741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:05.711405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.711691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.712020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.712783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:05.713018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:05.714421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c6c1-7eb2-40b7-ad8e-8b43365c1938 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:05.723187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 36/70] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:05.724485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.724838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.725114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.746527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 35/71] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:05.746698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:05.746775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.746872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:05.811955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 37/72] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:05.813041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.847327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c59a-eb31-4a22-900b-4e49c39f8dcc None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:05.879461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:05.880122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.880408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.881244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.882000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:05.882311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:05.883732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:05.891574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:05.891574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.914112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb6e4-7d07-48cb-8f58-84d7c1d9f9a5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:05.946606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:05.947470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.947764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.948043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.961214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:05.962762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a575-d19e-44b0-8773-d7b1c494e2e0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:05.964542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 38/74] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:05.965576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f689b-0892-4271-b8d5-65e780943146 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:05.965870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f689b-0892-4271-b8d5-65e780943146 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:05.966153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f689b-0892-4271-b8d5-65e780943146 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:05.967971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 39/75] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:05.968414 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f689b-0892-4271-b8d5-65e780943146 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:05.988068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f008-7818-4f64-aee2-ae6da5db5c27 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.023280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.024082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.024369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.024649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.034399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:06.042816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:06.043651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:06.044430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 37/76] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:06.045094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.075123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f689b-0892-4271-b8d5-65e780943146 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.107299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.108090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.108379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.108662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.118728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:06.126539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:06.127534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:06.128443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 40/77] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:06.129372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.144493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43ad8-10b5-4f3f-9c1e-c4f8f499eac3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.176584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.177444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.178430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.178740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.179930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.181372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93d29-22f7-4536-ad78-6c27d777a752 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.183007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 38/78] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.184264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.184557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.184836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.200284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:06.201482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:06.225996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0a44-a9f0-47e2-972d-786b3b729bb0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.257896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.258581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.258868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.259147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.264175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 39/79] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:06.265020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.325855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.327377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.357082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec0a7-5934-4015-941b-cf66c0a11b78 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.389245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.389908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.390191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.390503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.391255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:06.391559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.392943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.401231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 40/80] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.402010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.419940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 41/81] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:06.420777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.494510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5a20-f2d8-4ce4-a45c-bed1d399d421 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.512332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b11e3-140a-48d9-bffe-0c9c3e5318d4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.528292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.528965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.529251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.529533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.530282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:06.530623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.532002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.539924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 41/82] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.540696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.545139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.545791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.546080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.546363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.609996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.611496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.634307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4180d1b-23de-4e25-b7b1-2497eb4e228f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.666192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.666994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.667277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.667555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.668719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.670150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.671819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 42/83] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.672802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.704934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 42/84] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:06.705825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.766928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3104-0dc9-45be-8a6f-5ed308f76c08 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.798842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.799366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fde280-71e1-4edd-b71d-3f7b8e778fd6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.799707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.799996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.800276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.801496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.803042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.804700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 43/85] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.809201 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.832117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.832972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.833263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.833543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.835318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.836781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.838512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 43/86] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.839257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.903364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815db7-0dfe-4b2b-a993-cb226f488200 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.930855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82c77-71b6-4896-93d3-8998bb27d43a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:06.934709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.935574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.935859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.936138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.937329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.938801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.940432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 44/87] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:06.941190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:06.967570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:06.968237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:06.968521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:06.968804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:06.969511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:06.970998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:06.989731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 44/88] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:06 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:06.990765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.042199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbb8c1-4d81-4d96-a76d-6cac0b1c1355 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.079388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.080301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.080590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.080871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.082136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.083663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.085483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 45/89] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:07.086297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.119921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdba83-9f9d-47aa-b3d7-5d6b6351f76a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.157825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.158527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.158822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.159103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.192449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c51e-a720-4c9b-866c-f30ee08ddb59 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.227214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.227957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.228615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.228615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.229332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:07.229645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.230611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.231131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.232058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.236840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 46/90] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c6aede8225634ab38adb58c045afc716 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:07.237871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.353626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 45/91] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:07.354435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.367433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c254a-12cd-40a2-8840-0044b07c3850 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.405780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.406806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.407274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.407732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.464754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c994-fbc8-4c75-b635-4ae82437ef97 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.480229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.482015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.513491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.514161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.514453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.514760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.515673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=88a33ed416d14d68b26b32e116862838) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:07.515990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.517528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.530861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 46/92] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/role_assignments?user.id=88a33ed416d14d68b26b32e116862838&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:07.530861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.629505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 47/93] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:07.638806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.648498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775e2e6-e3e1-4f36-aafa-4855ffb5f786 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.684064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.684933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.685222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.685504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.686753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.688244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.690279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:07.696700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:07.789405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4431-c77a-44af-aee7-17215d21b091 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.805085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6404a8-7193-4304-9306-8296acf18c4b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:07.843646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.844315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.844603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.844885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.845745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:07.846048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.847565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da567a9-36d4-4373-879e-0b46c2a8c243 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.852337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:07.853202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:07.853488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:07.853767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] PATH_INFO: `/v3/projects/84f89d6a22434e13aba087a30f7df34f` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:07.855860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] RBAC: Authorizing `identity:get_project(project_id=84f89d6a22434e13aba087a30f7df34f)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:07.857311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:07.859223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 48/95] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/projects/84f89d6a22434e13aba087a30f7df34f => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:07.861942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:07.880549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:08.014561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1757b-b890-4da0-8c46-fd1b2fc1287e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:08.067446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:08.068194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:08.068991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:08.069275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:08.070135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=84f89d6a22434e13aba087a30f7df34f, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:08.070450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:08.072046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69121ac5-29e0-45cb-baee-624f918d532f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:08.078348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:07 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=84f89d6a22434e13aba087a30f7df34f&role.id=c6aede8225634ab38adb58c045afc716 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:10.074602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cc6-e60f-4284-91f5-68c4b949b128 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.075611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cc6-e60f-4284-91f5-68c4b949b128 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.076099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cc6-e60f-4284-91f5-68c4b949b128 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.077679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 49/98] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:10.083210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81072b2-041d-4dfe-a4eb-6658df9557de None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.084623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81072b2-041d-4dfe-a4eb-6658df9557de None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.085098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81072b2-041d-4dfe-a4eb-6658df9557de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.111419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c81072b2-041d-4dfe-a4eb-6658df9557de None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:10.112927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c81072b2-041d-4dfe-a4eb-6658df9557de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:10.200091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 50/99] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:10.235558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756cc6-e60f-4284-91f5-68c4b949b128 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:10.351901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756cc6-e60f-4284-91f5-68c4b949b128 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:10.360176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae014ad-317a-4b20-ba12-f6f993e9dca0 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.360726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae014ad-317a-4b20-ba12-f6f993e9dca0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.361228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae014ad-317a-4b20-ba12-f6f993e9dca0 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.362846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 51/100] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:10.369211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.369771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.370249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.403648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:10.405236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:10.410772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:10.411613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.411974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.412251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.435546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:10.451809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:10.452726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:10.453475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 50/101] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:10.459218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:10.576587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 52/102] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:10.619086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:10.640812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5bf22-81b3-4093-909c-ba7e3ea3c586 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:10.705062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:10.706104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.706624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.707098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.708064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:10.708565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:10.710713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536ba34-517a-4c10-af19-e1e344dc43ef None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:10.723733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 51/103] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:10.727844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfc9-05fd-447e-a9b6-c3e1f4c59ef7 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.729010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfc9-05fd-447e-a9b6-c3e1f4c59ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.730024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfc9-05fd-447e-a9b6-c3e1f4c59ef7 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.731712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 52/104] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:10.735193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dfc9-05fd-447e-a9b6-c3e1f4c59ef7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:10.804715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b7ba-6b28-475f-9dc9-a8515730535d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:10.871635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:10.872749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.873228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.873697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.892567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a0844fc2-a828-412e-bbda-c5861ae3498c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:10.900619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:10.901449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:10.902219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:10.904583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 53/105] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:10.906019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03de3-0e0d-4e71-9b3f-3e5285bd5f7a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.906531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03de3-0e0d-4e71-9b3f-3e5285bd5f7a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.907024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03de3-0e0d-4e71-9b3f-3e5285bd5f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.926944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-44e03de3-0e0d-4e71-9b3f-3e5285bd5f7a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:10.929303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-44e03de3-0e0d-4e71-9b3f-3e5285bd5f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:10.932522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dfc9-05fd-447e-a9b6-c3e1f4c59ef7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:10.973569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:10.976374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:10.976883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:10.977428 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] PATH_INFO: `/v3/users/0edcf153f562486ab2a657d8976d5916` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:10.994316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] RBAC: Authorizing `identity:get_user(user_id=0edcf153f562486ab2a657d8976d5916)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:10.996592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:10.999373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 53/106] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:10 2022] GET /identity/v3/users/0edcf153f562486ab2a657d8976d5916 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.000465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.014118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 54/107] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:11.015661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f488-cc3e-486a-a5b4-42048fab4b3c None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.016195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f488-cc3e-486a-a5b4-42048fab4b3c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.016702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f488-cc3e-486a-a5b4-42048fab4b3c None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.023215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 55/108] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:11.024570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4f488-cc3e-486a-a5b4-42048fab4b3c None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.138655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4f488-cc3e-486a-a5b4-42048fab4b3c None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.143586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe113cc-f689-4579-9b46-007317a19d66 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.176559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.178085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.178625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.179102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.185211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.185889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.186182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.186494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.187254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:11.187566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.188976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5a0e-ee13-42ed-af94-3eb2cff7d777 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.200333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 54/109] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.201690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.201990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.202275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.223087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:11.224297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:11.251531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.253453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186db840-72e1-4506-9afa-6bb90ed67652 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.297297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 55/110] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:11.298192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.379823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 56/111] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:11.379823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece380-33de-4898-a579-f8b1babb1ccd None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.379823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece380-33de-4898-a579-f8b1babb1ccd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.379823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece380-33de-4898-a579-f8b1babb1ccd None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.382778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 57/112] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:11.384469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece380-33de-4898-a579-f8b1babb1ccd None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.405511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf184656-a683-447e-b7d2-93d59ba98a01 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.439613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.440414 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.440700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.440978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.450909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:11.458548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:11.459452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:11.460222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 56/113] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:11.461392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.492295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece380-33de-4898-a579-f8b1babb1ccd None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.532195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.533081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.533369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.533645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.534903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.536357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.543265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 58/114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.543265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.565292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b057-9732-43f6-94d7-a6f7b6d43661 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.601116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.601930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.602376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.602694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.615864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-9df198d5-1aff-4b72-84ed-be0f96cc1b69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:11.626723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:11.627775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:11.628701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 57/115] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:11.629541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.629541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.629678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.647129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:11.648570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:11.659171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1505254-b755-4c6e-b252-39ad413e1b0d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.692614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.694109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.694401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.694711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.695924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.697395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.699153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 59/116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.699921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.715187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 58/117] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:11.730631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.794295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b16b58-fdf3-4d44-800e-b38ba21805b6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.811738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56617d1-a183-48bf-91b2-efdc89bac263 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.826944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.827617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.827904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.828210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.828956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:11.829262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.830691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.838691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 60/118] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.839245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.848330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.849192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.849666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.849948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.851163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.852665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43d3ad-d0e5-4a55-bf16-01443166c342 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.854534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 59/119] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.858550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b52ef-3c1a-4d21-af0c-c77dc7481c4d None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.858853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b52ef-3c1a-4d21-af0c-c77dc7481c4d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.859117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b52ef-3c1a-4d21-af0c-c77dc7481c4d None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.860394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 60/120] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:11.861105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b52ef-3c1a-4d21-af0c-c77dc7481c4d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.935463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a2847-3f82-4cc7-a310-9d67a85d00e0 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.965111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b52ef-3c1a-4d21-af0c-c77dc7481c4d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:11.967489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.968144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.968428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.968702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:11.969440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:11.969743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:11.971145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:11.979380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 61/121] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:11.980162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:11.997939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:11.998624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:11.998913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:11.999192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.000020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=0edcf153f562486ab2a657d8976d5916) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:12.000332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.002042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.007261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 61/122] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/role_assignments?user.id=0edcf153f562486ab2a657d8976d5916&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.008028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.083235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146933-b500-49ce-bd9c-677bbb866c65 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.117838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd1601-7477-4527-8a22-501cc4dbc7f7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.119419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.120171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.120464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.120745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.121982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.123507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.130159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 62/123] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.130159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.154994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.156595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.156951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.157236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.158580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.160077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bd34-5bf0-4638-821b-d996dc21ccb0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.161812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 62/124] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.163610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.163895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.164173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.181276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:12.182535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:12.232614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a6598-e6ee-4c0d-ad09-f2c514765095 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.250065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 63/125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:12.262610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.266103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.267154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.267444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.267720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/88a33ed416d14d68b26b32e116862838/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.269724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, user_id=88a33ed416d14d68b26b32e116862838, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.271251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.285754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 63/126] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:12 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/88a33ed416d14d68b26b32e116862838/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:12.286671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.379954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21193e-477d-4ad4-923a-4054d173a310 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.405726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b6432-35fa-41d3-b009-c95c50640e7b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.418567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.419841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.420331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.420809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.422389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.424160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.426504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 64/127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.428198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.444588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.445281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.445569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.445852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.447150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.448948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.488336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 64/128] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:42:12 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:12.488911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.559432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb217-52a2-4909-a1fa-2c8e3f585a2f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.596237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2ba4-cdb5-49cb-97db-142f10d44184 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.598682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.599828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.600178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.600520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.601940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.603563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.605639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 65/129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.606366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.632692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.633518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.633807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.634088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.656355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:12.665170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:12.666223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:12.667056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 65/130] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:12.667720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.795024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af310-519a-4ed3-9921-277615db5e9f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.806180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad143-5d91-46d0-aa4a-158d67a33306 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:12.836539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.837572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.837699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.837971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] PATH_INFO: `/v3/projects/84f89d6a22434e13aba087a30f7df34f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.840301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] RBAC: Authorizing `identity:get_project(project_id=84f89d6a22434e13aba087a30f7df34f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.841555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.844076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 66/131] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/projects/84f89d6a22434e13aba087a30f7df34f => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:12.844076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:12.848958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:12.850714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:12.852024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:12.852524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/35f74ce2156e467aabcf37500a18909d/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:12.854885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, user_id=35f74ce2156e467aabcf37500a18909d, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:12.856579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:12.874255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 66/132] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:12 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/35f74ce2156e467aabcf37500a18909d/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:12.875601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:13.030716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbc822-4031-496a-a52a-4e703c7e802a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:13.089503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a0e4-c1ae-44cf-b1a0-c04d94358087 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:13.112325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:13.113438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:13.113944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:13.114437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:13.115529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:13.116070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:13.117766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:13.137921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 67/133] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:13.143604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:13.151205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:13.152185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:13.152476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:13.152755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] PATH_INFO: `/v3/projects/84f89d6a22434e13aba087a30f7df34f/users/35f74ce2156e467aabcf37500a18909d/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:13.154891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] RBAC: Authorizing `identity:create_grant(project_id=84f89d6a22434e13aba087a30f7df34f, user_id=35f74ce2156e467aabcf37500a18909d, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:13.156380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:13.189483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:12 2022] PUT /identity/v3/projects/84f89d6a22434e13aba087a30f7df34f/users/35f74ce2156e467aabcf37500a18909d/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:13.286242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de26d-3f72-41c9-8f09-465fe7a97428 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:13.333229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:13.335048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:13.335589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:13.336073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:13.343617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:13.345458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:13.347650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 68/135] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:13 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:13.353836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:13.511188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e6b31-78e7-4423-be65-917d1b73054b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:13.545474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:13.546336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:13.546645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:13.546925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:13.551183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:13.553223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a5db2-3c79-4b29-997a-96ea67c02e6c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:13.555152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 68/136] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:13 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:13.560584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:13.713102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f133-0672-4360-9e04-35a9d6ec351d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:13.759166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:13.760084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:13.760378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:13.760665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/35f74ce2156e467aabcf37500a18909d/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:13.763052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, user_id=35f74ce2156e467aabcf37500a18909d, role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:13.764587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a716ab-be3f-4357-98c3-6ffa3a73cba5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:13.781070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 69/137] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:13 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/35f74ce2156e467aabcf37500a18909d/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:14.857678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6d99-f706-4e3d-9a88-8e7a248f1e2d None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:14.858165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6d99-f706-4e3d-9a88-8e7a248f1e2d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:14.858165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6d99-f706-4e3d-9a88-8e7a248f1e2d None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:14.859561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 69/138] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:14.876460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:14.876957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:14.877051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:14.903719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:14.904951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:14.985919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 70/139] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:15.031794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6d99-f706-4e3d-9a88-8e7a248f1e2d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:15.164686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6d99-f706-4e3d-9a88-8e7a248f1e2d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:15.211210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:15.212361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:15.212882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:15.213358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:15.223600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:15.231483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:15.232307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:15.233046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:15.235344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 70/140] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:15.241032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:15.411543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e656d5-7ca4-443b-9656-76cb82b11f27 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:15.454758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:15.455811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:15.456336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:15.456820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:15.457796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:15.458310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:15.460457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:15.473877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 71/141] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:15.480071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:15.640667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9539-93ab-405c-bdf8-0e4f244d4bd6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:15.687371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:15.688249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:15.688532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:15.688811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] PATH_INFO: `/v3/users/0edcf153f562486ab2a657d8976d5916` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:15.690000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] RBAC: Authorizing `identity:get_user(user_id=0edcf153f562486ab2a657d8976d5916)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:15.691467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:15.693450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 71/142] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:15 2022] GET /identity/v3/users/0edcf153f562486ab2a657d8976d5916 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:15.699353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:15.852031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c8c1-7233-48ac-baf4-a7b81eda9d0b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:15.898836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:15.900512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:15.901019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:15.901489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:15.907271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:15.909028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dca2e-7b5e-47c0-965a-e7958980bb19 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:15.911390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 72/143] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:15 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:15.923518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:15.995914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21fc5-75cb-4c7e-820c-15164c2cb8ec None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:15.996564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21fc5-75cb-4c7e-820c-15164c2cb8ec None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:15.997122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21fc5-75cb-4c7e-820c-15164c2cb8ec None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:15.998743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 73/144] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:16.000053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c25-9de2-4402-a654-18b2d0dad5ff None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.000549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c25-9de2-4402-a654-18b2d0dad5ff None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.001292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d30c25-9de2-4402-a654-18b2d0dad5ff None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.006802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 74/145] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:16.008172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.008678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.009169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.032979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39f4e-c6da-4bb6-a6c3-edd177574feb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.039456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:16.040892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:16.075961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.076869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.077155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.077439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/0edcf153f562486ab2a657d8976d5916/roles/23ad73e871854ab0af6f973f0ca5674c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.083588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, user_id=0edcf153f562486ab2a657d8976d5916, role_id=23ad73e871854ab0af6f973f0ca5674c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:16.085576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb6488-c259-403a-bd2a-7a9fe8533255 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:16.111298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:15 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/users/0edcf153f562486ab2a657d8976d5916/roles/23ad73e871854ab0af6f973f0ca5674c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:16.112590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.112942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.113235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.135770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 75/147] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:16.147703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:16.148982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:16.163905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.285282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c50d-26a4-459c-8808-f68ed0743377 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.304567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 73/148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:16.323899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.324718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.325007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.325290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.336852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:16.342147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:16.345055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:16.346127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:16.347112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:16.354579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 76/149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:16.362149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.485943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008498-a357-45f4-8b60-52c7e3889a92 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.525867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c209d8-ee8b-4128-905e-91b48ddb99b8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.533962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.535087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.535591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.536058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.538087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:16.540111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36714f26-ede3-4463-aebd-3d2696acedc0 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:16.542329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 74/150] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:16.543843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b61-5ea0-452c-a9e7-07f9607072ad None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.544334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b61-5ea0-452c-a9e7-07f9607072ad None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.544801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b61-5ea0-452c-a9e7-07f9607072ad None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.548981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 75/151] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:16.552101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.552637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.553132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.572845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.574078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.574599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.574721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:16.575198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.575976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:16.576360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:16.576859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:16.578708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:16.590382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 77/152] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:16.592033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.648664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 76/153] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:16.649787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.711833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe78-e0fd-4004-a546-a03706a31b54 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.748517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.749547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.750025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.750508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.751707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:16.751809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e5bfc-4959-4c64-a777-269250f5b63a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:16.753470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16047a-30e4-417f-b01e-c9a2a11ad101 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:16.779948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 78/154] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:16 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:16.786484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8064b-10b1-479d-a8b5-7f5bd92b9e54 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.787539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8064b-10b1-479d-a8b5-7f5bd92b9e54 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.787725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8064b-10b1-479d-a8b5-7f5bd92b9e54 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.789214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 79/155] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:16.789985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8064b-10b1-479d-a8b5-7f5bd92b9e54 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:16.796156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:16.797055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.797339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.797612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] PATH_INFO: `/v3/users/88a33ed416d14d68b26b32e116862838` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.799973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] RBAC: Authorizing `identity:get_user(user_id=88a33ed416d14d68b26b32e116862838)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:16.804247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c03ee-d636-46dd-91a7-3b468ef6bf25 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:16.806102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 77/156] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/users/88a33ed416d14d68b26b32e116862838 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:16.810857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:16.811149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:16.811436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:16.844149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:16.845353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:16.958291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 78/157] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:16.959589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.016132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8064b-10b1-479d-a8b5-7f5bd92b9e54 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.062159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.063444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.063932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.064397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.068578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a6cfb-32fa-4fc5-aefb-4295e22eb559 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.076884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:17.085818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:17.086704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:17.087468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:17.089806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 80/158] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:17.090822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.104077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.104973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.105451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.105860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.176819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.178911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596ce82-a6ab-4f9b-adda-103f09f1ee9c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.204524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858335f-04d5-41ce-b4c6-1a98f839458a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.242740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.243471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.243743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.244015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.262106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:17.270025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:17.271441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:17.272417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 81/159] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:17.277314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.298837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 79/160] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:17.300278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e664e-fc6d-4a54-9447-b68f1400fb43 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.300567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e664e-fc6d-4a54-9447-b68f1400fb43 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.300841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e664e-fc6d-4a54-9447-b68f1400fb43 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.302489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 80/161] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:17.303281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e664e-fc6d-4a54-9447-b68f1400fb43 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.418930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3300-ee28-4d1d-95c9-2962f346d129 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.443482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e664e-fc6d-4a54-9447-b68f1400fb43 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.461769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.462847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.463331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.463816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.464758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:17.465355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.468943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.477960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 82/162] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:17.479131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.489125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.489833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.490118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.490393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.491185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:17.491490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.493630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a9c3-8657-4a75-bc75-bb882324127f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.504375 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 81/163] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:17.506191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.506512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.506798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.527020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:17.528227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:17.605661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8053-b14d-49d7-b762-9af65bae27de None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.612173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 82/164] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:17.612173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.669615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.670881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.671392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.671897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.673331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.675160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.677145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 83/165] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:17.678726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.732810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac0300-e17b-4a64-916d-5d4fb194edf0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.788340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.789957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.790560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.791050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.793125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.795354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.798177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 83/166] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:17.799517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.815375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6fedc-e9ec-42b5-95f6-18e9d4d9d0ee None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.854717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.855713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.856054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.856334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.857567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:17.859144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:17.861141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 84/167] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:17.862022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:17.929216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0bf8-b4a1-40db-9501-edc42b2ffe5c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.970259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:17.972262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:17.972885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:17.973471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:17.984614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf7567-1aa0-4af2-9d1a-d9f17a569c20 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:17.985678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:17.995636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:17.996509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:17.997277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:18.000331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 84/168] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:18.001924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.091922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.092565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.092792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.093073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.093924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=88a33ed416d14d68b26b32e116862838) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:18.094240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.095745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.112842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 85/169] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:17 2022] GET /identity/v3/role_assignments?user.id=88a33ed416d14d68b26b32e116862838&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:18.113508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.120380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0e80-3eb7-423c-b526-a3562717dac3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.160451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.162073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.162600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.163174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.245445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.247771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.364227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 85/170] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:18.365936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.371540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30a666-97f7-4248-ba51-806927eeb9fe None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.455522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.456190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.456479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.456785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.485787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d31a9-e467-41c9-9ff5-9c72515f57e2 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.532329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.533006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.533288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.533563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.534566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:18.535352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.536837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.538254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.539829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.546692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 86/171] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:18.547617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.662470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 86/172] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:18.663392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.676089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94ec31-6211-4024-b7d7-4966917d3cbc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.718148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.719477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.719784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.720065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.721287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.722786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.725822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 87/173] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:18.726795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.777711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d851-dede-4ca6-8a4d-1ae8706cef22 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.843857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e94d5-6aeb-4abd-a8c5-8ea4f64ba586 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:18.856271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.857213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.857503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.857783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] PATH_INFO: `/v3/users/35f74ce2156e467aabcf37500a18909d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.862611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] RBAC: Authorizing `identity:get_user(user_id=35f74ce2156e467aabcf37500a18909d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.864080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.866042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 87/174] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/users/35f74ce2156e467aabcf37500a18909d => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:18.866816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:18.884574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:18.885882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:18.886169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:18.886447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] PATH_INFO: `/v3/projects/84f89d6a22434e13aba087a30f7df34f` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:18.887997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] RBAC: Authorizing `identity:get_project(project_id=84f89d6a22434e13aba087a30f7df34f)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:18.889450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:18.891257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 88/175] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/projects/84f89d6a22434e13aba087a30f7df34f => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:18.892037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:19.004426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961382c-e3b6-456a-a78e-bfb7af2a5478 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:19.042488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:19.043145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.044141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.044565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.085790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7a77c-0424-43f1-836f-0ea1b5372d66 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:19.121353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:19.122874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:19.162876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:19.163613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.163905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.164188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.165079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:19.165400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:19.166989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:19.182987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 88/176] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c6aede8225634ab38adb58c045afc716 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:19.183692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:19.269934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 89/177] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:19.277346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:19.374725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea70487-bc2d-4b3f-ad07-1a6cf963339f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:19.425352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:19.426408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.427051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.428100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.429170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=84f89d6a22434e13aba087a30f7df34f, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:19.429924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:19.432699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:19.440573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 89/178] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:19 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=84f89d6a22434e13aba087a30f7df34f&role.id=c6aede8225634ab38adb58c045afc716 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:19.462607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb052f6-7d63-4768-b830-97551851ab5a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:19.520513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:19.520513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.520513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.520513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.522712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:19.524308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3033960-432e-4ed1-926b-7a66c9106594 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:19.525835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 90/179] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:19 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:19.535006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:19.654697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566152a6-d3d7-47a1-9a59-b7b428423b25 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:19.693335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:19.694394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.694913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.695391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.696433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=35f74ce2156e467aabcf37500a18909d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:19.696967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:19.698750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c37b7-4837-4cef-978a-ec36c0879724 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:19.709772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 90/180] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:19 2022] GET /identity/v3/role_assignments?user.id=35f74ce2156e467aabcf37500a18909d&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:19.926881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8feac-ef41-4ff2-89bb-31c85107b9a8 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.927759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8feac-ef41-4ff2-89bb-31c85107b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.927904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8feac-ef41-4ff2-89bb-31c85107b9a8 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.929550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 91/181] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:19.936229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:19.936525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:19.936810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:19.957659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:19.959486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:20.037637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 91/182] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:20.063680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8feac-ef41-4ff2-89bb-31c85107b9a8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.186911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8feac-ef41-4ff2-89bb-31c85107b9a8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.221039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.221842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.222123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.222392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.233050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-22ddea9d-cb27-4920-9760-beee0fb68971 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:20.241213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:20.242069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:20.242888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 92/183] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:20.248445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.281022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d24c-ff80-4654-8985-3ab12354f340 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.281559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d24c-ff80-4654-8985-3ab12354f340 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.281982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d24c-ff80-4654-8985-3ab12354f340 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.283542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 93/184] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:20.289217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.289673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.289950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.306660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:20.308089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:20.377416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633b86-c43a-4da9-9099-8bcc22a9c8ca None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.379058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 94/185] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:20.403332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.417384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.418236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.418641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.418928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.420091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:20.420404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:20.422129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:20.433587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 92/186] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:20.439100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.507377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e904-641d-4a0d-9853-f5b744b5a471 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.548226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.549454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.549808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.550318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.555080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc66a-bc9e-4f0a-8a1f-193b1ea7a741 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.563791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:20.574258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:20.575190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:20.575963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 95/187] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:20.584434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.598525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.600012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.600687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.600978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] PATH_INFO: `/v3/users/0edcf153f562486ab2a657d8976d5916` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.602527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] RBAC: Authorizing `identity:get_user(user_id=0edcf153f562486ab2a657d8976d5916)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:20.604669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:20.606709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 93/188] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/users/0edcf153f562486ab2a657d8976d5916 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:20.615263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.695635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e1dee-fcc8-4a22-aa2d-013dbe208b91 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.734168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.735108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.735532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.735973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.736913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:20.737392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:20.739027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:20.746645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4330d-53b0-48c1-8a7c-a5aa88da8560 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.747789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 96/189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:20.753585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.793610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.795422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.796766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.797214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.862955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1116467-1c75-4e2c-9545-8928dad60cc7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:20.886129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:20.887959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8baf21-10d8-4b70-bf48-9cd3f8d23f0b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:20.901121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:20.902352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.902883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.903369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.922814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:20.924669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:20.928182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 97/190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:20.933542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:20.994956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:20.996294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf5d1-e937-40d5-be03-80c7626d2db1 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:20.996587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf5d1-e937-40d5-be03-80c7626d2db1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:20.996863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdf5d1-e937-40d5-be03-80c7626d2db1 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:20.998140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 95/192] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:21.000394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdf5d1-e937-40d5-be03-80c7626d2db1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.048026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffe2e6-8d32-471d-af7e-11692fbac41a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.082919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.084169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.084455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.084734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.100654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdf5d1-e937-40d5-be03-80c7626d2db1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.132480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.133319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.133600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.133871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.135050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.136583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fda036-801c-4fc5-98c0-3efaf24ac422 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.138261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 96/193] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.140573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd46af-1be8-4aee-b107-a63262764716 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.140869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd46af-1be8-4aee-b107-a63262764716 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.141148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd46af-1be8-4aee-b107-a63262764716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.148851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.150332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d369d7-8bff-494e-8008-fadc5a6c1453 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.157231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e9fd46af-1be8-4aee-b107-a63262764716 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:21.158409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e9fd46af-1be8-4aee-b107-a63262764716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:21.220219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 97/194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:21.221515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98782-78c0-4861-be11-1420d57fff87 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.221809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98782-78c0-4861-be11-1420d57fff87 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.222090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c98782-78c0-4861-be11-1420d57fff87 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.223396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 98/195] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:21.224264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c98782-78c0-4861-be11-1420d57fff87 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.251045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 98/196] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:42:21.251045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.251045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.251045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.267001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:21.268180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:21.324114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c98782-78c0-4861-be11-1420d57fff87 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.329952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 99/197] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:21.330800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.358100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.358831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.359120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.359400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.360235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a, user.id=0edcf153f562486ab2a657d8976d5916) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:21.360551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.361993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.367704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 99/198] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/role_assignments?user.id=0edcf153f562486ab2a657d8976d5916&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.368554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.431807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd72ed-edab-4284-8b24-0b67c86da84d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.470432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.471305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.471589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.471868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.473065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.473906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1743-d0c1-4331-ac06-948275fecc27 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.474652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.476369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 100/199] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.477414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.527944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.528815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.529685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.529976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.531339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.534483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.541879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 100/200] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.541879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.609051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472183c-5ddb-432e-ad5a-ba2a4dc1c3e9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.643870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dfd39-0d4f-4131-a667-b3c239bdda49 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.644563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.645367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.645649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.646428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.656309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:21.664751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:21.665618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:21.666735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 101/201] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:21.667639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.682040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.682746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.683030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.683306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.684020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.685475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.704213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 101/202] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:21 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:21.705029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:21.769608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39398a93-713f-4de1-93c3-b097499f2f21 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.807569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.808505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.808798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.809076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.809945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3f5773e7a7df457197df7420bf06f60e) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:21.810261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.811828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.817717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 102/203] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/role_assignments?user.id=3f5773e7a7df457197df7420bf06f60e&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.830419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed5580-d543-4d60-a4fe-85427459e44f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:21.870115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:21.870839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:21.871126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:21.871403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:21.872176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:21.872486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:21.873922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:21.884936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 102/204] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:21.890532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:22.000488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243eccf-30c3-4131-936e-62ef6940fd8d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:22.038551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:22.039479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:22.039763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:22.040046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:22.041528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:22.043250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:22.045084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 103/205] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:21 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:22.050563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:22.155064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30473b55-0289-4940-9e47-6f4b2993b262 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:22.189008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:22.189668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:22.189956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:22.190230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:22.258127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:22.259643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:22.360891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 103/206] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:22.367216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:22.471132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e81b-4a34-4a41-acfd-205959e84d4c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:22.508399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:22.509273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:22.509560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:22.509840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:22.511072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:22.512521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8d79e-aeb0-4f77-85a8-2bea015333df None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:22.520352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 104/207] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:22 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:22.520522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:22.621245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042bace-1d11-49fa-bb71-8bc59e3c80e0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:22.655368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:22.656027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:22.656316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:22.656597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:22.657434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3f5773e7a7df457197df7420bf06f60e) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:22.657750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:22.659239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a80eb8-ba65-48af-b3a9-f681f1f297b6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:22.668456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 104/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:22 2022] GET /identity/v3/role_assignments?user.id=3f5773e7a7df457197df7420bf06f60e&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:24.194117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb9a1-285a-4f0c-921b-5be96bfd5b9a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.194678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb9a1-285a-4f0c-921b-5be96bfd5b9a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.194678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb9a1-285a-4f0c-921b-5be96bfd5b9a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.196091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 105/209] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:24.202048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.202862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.203284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.219566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bae21-dc0c-42f0-ada3-48fab9b4e02b None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.220270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bae21-dc0c-42f0-ada3-48fab9b4e02b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.220750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bae21-dc0c-42f0-ada3-48fab9b4e02b None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.221072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:24.222260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:24.222792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 106/210] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:24.228511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.228793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.229072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.246541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:24.248114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:24.290017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 105/211] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:24.314659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.319888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 107/212] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:24.348068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.415968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20c8c0-5f79-44f6-a7cc-bac7e01b34fc None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.449507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.450352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.450688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.450969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.452140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:24.452704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662d557-997a-44a2-a7b4-e1f968db831f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.453608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1223e11-bf9a-44ca-a7b9-e0d0cf412e78 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:24.455277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 106/213] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:24.460260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efc02b-7fff-4ecf-976f-0936418253f4 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.460260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efc02b-7fff-4ecf-976f-0936418253f4 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.460260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efc02b-7fff-4ecf-976f-0936418253f4 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.460260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 107/214] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:24.461009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efc02b-7fff-4ecf-976f-0936418253f4 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.493908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.494733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.495017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.495294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.505575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-93e27e7b-3a07-44ff-a32b-0d9b23f58bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:24.513137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:24.514077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:24.515297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 108/215] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:24.520327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.520617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.521824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.540595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:24.541769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:24.571373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efc02b-7fff-4ecf-976f-0936418253f4 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.605144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.605805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.606086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.606357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.607094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:24.608084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 109/216] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:24.608619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:24.609258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.640514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 108/217] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:24 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:24.642675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.726162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c217335-295b-4ce9-a87c-b32d218db5dc None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.767493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.768184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.768463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.768737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.769567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:24.769877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:24.771956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:24.780790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 110/218] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:24.783598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0c51-0a82-43eb-965f-6d8a3773a24c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.786724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.834258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.834258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.834579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.834817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.850752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:24.858991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:24.859912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:24.860699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 109/219] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:24.865891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.902418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b0757-6262-4334-9681-9ab80c584b5e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:24.941267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:24.942135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.942417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.943258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.944735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:24.946181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359439d-b154-4f45-8d8a-1fe89af6f74c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:24.947884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 111/220] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:24.949216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf18c3-9f00-4596-95da-6bacdad84e43 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:24.949504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf18c3-9f00-4596-95da-6bacdad84e43 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:24.949776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf18c3-9f00-4596-95da-6bacdad84e43 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:24.951023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 112/221] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:24.955344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf18c3-9f00-4596-95da-6bacdad84e43 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:24.980292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f61c0-6bd7-4ec6-a8ab-419f0bdc86fa None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.024952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.025871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.026158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.026437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.027217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:25.027528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.028930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b85b5f-a1a9-4e0b-86da-429311bb0483 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.039488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 110/222] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:25.040789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.041098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.041363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.063671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:25.065493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:25.086320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf18c3-9f00-4596-95da-6bacdad84e43 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.128092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.129112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.129398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.129673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.131839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.133537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.136095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 113/223] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:24 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:25.136672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.138862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 111/224] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:25.142504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.247052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8c907-a9ee-4fe7-b0cc-e0ecfe75bcb0 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.254792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621cc9-7be1-4ebd-be22-4a39c9c1f73a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.283109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.284319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.284779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.285269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3f5773e7a7df457197df7420bf06f60e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.288048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, user_id=3f5773e7a7df457197df7420bf06f60e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.289208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.289718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.290520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.290946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.291360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] PATH_INFO: `/v3/users/3df84a43c98647f9a3f33bd714171328` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.310501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 112/225] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:25 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3f5773e7a7df457197df7420bf06f60e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:25.310501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.311074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] RBAC: Authorizing `identity:get_user(user_id=3df84a43c98647f9a3f33bd714171328)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.312588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.318797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 114/226] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/users/3df84a43c98647f9a3f33bd714171328 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:25.323817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.446577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ec42-2de7-4a2a-8d2d-1f3221cc08a6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.473019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba19bf-07cc-4fe5-b727-a745e6057f8b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.528324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.528577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.528855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.529126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.532245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.532889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.533163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.533432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.550066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:25.560991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:25.561876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:25.563485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:25.565869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 113/227] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:25.573674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.627954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.629901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.739734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 115/228] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:25.741341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403329-1393-4f1a-9410-187a8a99882b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.746214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.801334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:25.802590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:25.803714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:25.804767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:25.805862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:25.806985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:25.814495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:25.816971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 114/229] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:25.825217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:25.943043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4388-26ad-4716-bb54-281e3aef1fe9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:25.984414 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7fd11-ebf3-496b-8468-b31a6d1a10f6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:26.005849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:26.006734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:26.007012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:26.007282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:26.009553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:26.011043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:26.018547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 116/230] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:26.019642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:26.035472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:26.036892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:26.037373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:26.037836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:26.042412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:26.044785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:26.048206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 115/231] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:25 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:26.054564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:26.147893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6fa29-26a8-4e3f-ac6f-40f7a3ddae69 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:26.185279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:26.186288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:26.186778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:26.187239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:26.188267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3df84a43c98647f9a3f33bd714171328) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:26.188764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:26.190399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:26.196473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 117/232] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:26 2022] GET /identity/v3/role_assignments?user.id=3df84a43c98647f9a3f33bd714171328&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c6aede8225634ab38adb58c045afc716 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:26.243632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603703d-1cf5-4c1c-b03d-3ccc251a97ea None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:26.286264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:26.287311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:26.287596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:26.287875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:26.295485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:26.297018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17c87a-a79c-4a1d-9b7e-5d5c5abaab2a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:26.298935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 116/233] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:26 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:26.305107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:26.428912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189c5b4-bb9e-4d1a-9e68-869236a4ed1f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:26.463913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:26.465126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:26.465634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:26.466120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3f5773e7a7df457197df7420bf06f60e/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:26.468522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, user_id=3f5773e7a7df457197df7420bf06f60e, role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:26.470156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667aa88-b49c-4d33-8c13-8f85bba63d0e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:26.485424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 118/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:26 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3f5773e7a7df457197df7420bf06f60e/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:27.365906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25358a7-0aed-47c7-92d7-e9fdd7abcea4 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.366417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25358a7-0aed-47c7-92d7-e9fdd7abcea4 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.366534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25358a7-0aed-47c7-92d7-e9fdd7abcea4 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.367878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 117/235] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:27.373218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.373659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.373832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.377544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524575b-6aaa-41b3-8c1e-be5fad873609 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.377838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524575b-6aaa-41b3-8c1e-be5fad873609 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.378120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524575b-6aaa-41b3-8c1e-be5fad873609 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.379742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 118/236] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:27.384945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.385238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.385522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.402676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:27.403465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:27.403987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:27.404641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:27.473573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:27.501951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:27.532113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 119/238] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:27.563064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:27.609866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14b353-f7c1-4deb-9c23-b8a26953d728 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:27.644731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:27.645452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.646277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.646584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.647781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:27.649245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:27.650918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 120/239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:27.656268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:27.760712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a37d38-3cbf-46ac-9164-2356ccd57435 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:27.796710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea2e9d-5da0-451b-ab3a-2f7154d8b549 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:27.802477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:27.802477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.802477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.802477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.802803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:27.802803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:27.827242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 121/240] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:27 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:42:27.882474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:27.883322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:27.883606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:27.883881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:27.904446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-aad0cf03-07c0-4be6-b5f5-62a03ad92820 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:27.913142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:27.914063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:27.914952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:27.918732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 120/241] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:27.923694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.108723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1df66-f2bd-40b0-bcd8-2bd98384058c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.139809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a5-6e32-41f1-8d9f-0b67737f6b74 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.140442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a5-6e32-41f1-8d9f-0b67737f6b74 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.140933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a5-6e32-41f1-8d9f-0b67737f6b74 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.144965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 121/242] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:28.146637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.147342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.147634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.147917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.148700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:28.149017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.150580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.151839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.152330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.152798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.161424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 122/243] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:28.165660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.174015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:28.175450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:28.248312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 122/244] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:28.274544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.275573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed698cc-8952-4777-96fc-5c0383901e46 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.314157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.315400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.315880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.316344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] PATH_INFO: `/v3/users/1e98026146cc46b4a469faae898abdab` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.331350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] RBAC: Authorizing `identity:get_user(user_id=1e98026146cc46b4a469faae898abdab)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.333679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.336022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 123/245] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/users/1e98026146cc46b4a469faae898abdab => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:28.342797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.384216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55e6b-4039-43f2-857d-06d2859f27d1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.427898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.428633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.428922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.429194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.446732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:28.448116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedf418-80ef-4bb0-9fb6-ddde87e9ed95 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:28.457960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:28.459624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:28.460443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:28.465050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 123/246] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:28.470874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.487632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.488290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.488580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.488860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.590272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.592723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.603294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7999e-2ed3-4217-bede-37622895a8ba None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.642825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.644055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.644925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.645358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.646321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:28.646810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.649101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.660012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 124/247] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:28.666392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.717384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:42:28.722968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.804008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481babb-73ed-4daf-ae6b-c32f6465c023 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.866155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.867655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.869349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.870817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.874950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.876897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.879773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 125/249] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:28.887637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:28.905808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7e7d-a6a5-4782-b261-25d1b68cd68e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:28.976906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:28.977707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:28.977993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:28.978343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:28.979759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:28.982979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:28.985010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 125/250] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:28.993653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.095985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6132e3-e69e-4d4d-9049-dff44a79d4c7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.147587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964ccd-d26e-4ecc-acad-c44f645a8bbd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.175781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.176450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.176734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.177045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.184651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.185318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.185604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.185883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.186758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=1e98026146cc46b4a469faae898abdab) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:29.187076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:29.188551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7ed3d-971b-4c47-a4e2-1b94fa75af67 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:29.196300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 126/251] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/role_assignments?user.id=1e98026146cc46b4a469faae898abdab&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:29.197901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0223d9-8b3a-4ba0-901e-4bcecec505e5 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.198267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0223d9-8b3a-4ba0-901e-4bcecec505e5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.198503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0223d9-8b3a-4ba0-901e-4bcecec505e5 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.204355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 127/252] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:29.209270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.209809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.210224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.239280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:29.240956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:29.318446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:29.319952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32154b-e807-4b9d-803a-2bd92703d40c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:29.345922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 128/253] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:29.366838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.463622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 126/254] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:29.467493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc31e0-c17e-495d-959a-a4e56aa58336 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.467493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc31e0-c17e-495d-959a-a4e56aa58336 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.467493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc31e0-c17e-495d-959a-a4e56aa58336 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.467493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 127/255] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:29.472329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc31e0-c17e-495d-959a-a4e56aa58336 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.482806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3855c2-2305-46cf-b666-1d31b6860e87 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.519195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.520336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.521791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.522281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.536053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-cd78d32a-e2ba-47c3-b5bf-a28317818976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:29.544477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:29.545448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:29.546232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:29.553617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 129/256] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:29.555424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.555917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.556404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.574501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:29.576012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:29.634978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc31e0-c17e-495d-959a-a4e56aa58336 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.647579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 130/257] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:29.648868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.683811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.684727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.685017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.685336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.691303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:29.692902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:29.694877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 128/258] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:29 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:29.695725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.750404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43688e9f-792f-43b4-94db-2c1a12e01270 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.788155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.788753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.789039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:29.789320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:29.790075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:29.790381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:29.791805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:29.803353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 131/259] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:29.804179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:29.904226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786e0be-e9c3-454e-bd4a-1039b9abebab None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.960908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f9e45-4e1f-498a-b56b-1b21bfcc2967 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:29.998823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:29.999498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:29.999783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.000062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.001178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3f5773e7a7df457197df7420bf06f60e) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:30.001492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.003014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.010555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:29 2022] GET /identity/v3/role_assignments?user.id=3f5773e7a7df457197df7420bf06f60e&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:30.011514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.015392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.018488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.018488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.018488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.062572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:30.079862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:30.080754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:30.081522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:30.084106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:30.095531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.130515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9dfa2-3812-4cc6-b615-f47cdf6e31ab None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.164559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.165460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.165746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.166023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] PATH_INFO: `/v3/users/3df84a43c98647f9a3f33bd714171328` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.167667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] RBAC: Authorizing `identity:get_user(user_id=3df84a43c98647f9a3f33bd714171328)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.169141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.170812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 133/262] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:30 2022] GET /identity/v3/users/3df84a43c98647f9a3f33bd714171328 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:30.189399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.364060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f964c-ded0-4439-ba83-18df33cfb4a7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.391791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aced3d-f54c-4989-815b-639c44266795 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.434052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.435885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.436171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.436450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.437897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.440690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.445441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 134/263] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:30 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:30.453027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.454200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.454937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.455281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.455560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.456374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:30.462844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.464283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.473575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 130/264] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:30.483540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.677484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f3f0e-5f19-4f1d-8e4d-6068f8547089 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.716097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e55a4a-df61-4004-afbe-89de8400a500 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.733885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.734626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.734910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.735185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] PATH_INFO: `/v3/users/3f5773e7a7df457197df7420bf06f60e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.743246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] RBAC: Authorizing `identity:get_user(user_id=3f5773e7a7df457197df7420bf06f60e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.743246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.745407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 131/265] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:30 2022] GET /identity/v3/users/3f5773e7a7df457197df7420bf06f60e => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:30.753355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:30.760691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.761890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.762375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.762893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3df84a43c98647f9a3f33bd714171328/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:30.765093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, user_id=3df84a43c98647f9a3f33bd714171328, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:30.767763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:30.791991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 135/266] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:30 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/3df84a43c98647f9a3f33bd714171328/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:30.889637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b5e8-e2b5-40c5-909e-a782dda7507d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:30.930909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:30.931502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:30.931782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:30.932056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.012943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:31.014618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:31.125675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 132/267] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:31.138732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:31.253193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684181c2-8f82-4b31-a14f-93e1873b6e94 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:31.292395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:31.293642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.294127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.294635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.296050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:31.297719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeca4a-b886-41d4-b42b-bee4b73ba563 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:31.299976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 136/268] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:31 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:31.306215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:31.413539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218b6e6-0e04-4501-805d-f8673ee367d4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:31.453880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:31.454557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.454841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.455122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.455957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3f5773e7a7df457197df7420bf06f60e) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:31.456267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:31.457734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165951-bd7e-41fe-91d5-18785d12644d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:31.464821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 133/269] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:31 2022] GET /identity/v3/role_assignments?user.id=3f5773e7a7df457197df7420bf06f60e&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:31.747405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259677-17f1-4705-8373-8efd491ef052 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.748399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259677-17f1-4705-8373-8efd491ef052 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.748984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c259677-17f1-4705-8373-8efd491ef052 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.750560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea668-3901-44e7-8d12-582687f34167 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.751213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea668-3901-44e7-8d12-582687f34167 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.751410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ea668-3901-44e7-8d12-582687f34167 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.751685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 137/270] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:31.753066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 134/271] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:31.758640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.758933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.759217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.761104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:31.761597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:31.762080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:31.779621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:31.780701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:31.781226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:31.782179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:31.852308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 135/272] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:31.854365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 138/273] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:31.876703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:31.878103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:31.985411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860a05-8ea0-4c7b-bae4-a781aad2e639 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:31.989257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b33491-4809-4af4-9549-c73797c7ca79 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.024243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.025437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.025932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.026295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.027615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.028700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.029176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.029696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.031116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.032780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.034929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 136/274] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:32.039451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:32.040164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:32.049218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:32.050081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:32.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:32.052873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 139/275] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:32.059742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.158289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6343d9-d3c2-4337-9ed1-a9d4473747ad None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.183749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369972-d485-4092-889d-d9282d9cd03a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.195764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.196354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.196646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.196925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.197653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.199184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.224654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.225719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.226220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.226739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.227735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:32.228238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.229551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 137/276] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:32 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:32.230058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8032b6-7c15-415e-b665-9c421e6fccdc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.241422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 140/277] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:32.247357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.365508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64f500-5915-4774-a9bb-274989326f85 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.388411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274dbbc-d5d1-4dc3-9fd9-8dc3a28b9984 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.388754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274dbbc-d5d1-4dc3-9fd9-8dc3a28b9984 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.388998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274dbbc-d5d1-4dc3-9fd9-8dc3a28b9984 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.394691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 141/278] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:32.396205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.396499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.396782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.404248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.405141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.405423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.405701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] PATH_INFO: `/v3/users/955b1e148d1143168d7ac41caa3a4b17` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.422044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] RBAC: Authorizing `identity:get_user(user_id=955b1e148d1143168d7ac41caa3a4b17)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.422571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:32.423595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.424008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:32.425496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 138/279] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/users/955b1e148d1143168d7ac41caa3a4b17 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:32.431728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.504307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 142/280] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:32.528244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.559748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91d95c-6702-4400-8bc9-7b04e29a850e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.604040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.604652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.604994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.605336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.606237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, user.id=955b1e148d1143168d7ac41caa3a4b17, scope.system=all) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:32.606595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.608039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.613722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 139/281] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/role_assignments?user.id=955b1e148d1143168d7ac41caa3a4b17&scope.system=all&role.id=c6aede8225634ab38adb58c045afc716 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:32.644392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff929c93-67ac-45a8-9346-7b388f135f03 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.685846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.687010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.687444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.687899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.700626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:32.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:32.709978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:32.710994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:32.713424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 143/282] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:32.719106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:32.840689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c0ba-645d-4f3b-b28b-a1e12f5a61dc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:32.876415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:32.877323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:32.877749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:32.878192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:32.879121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] RBAC: Adding query filter params (name=reader) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:32.879567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:32.881346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:32.890216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 140/283] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:32.895612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:33.026972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b3d30-e133-43dd-a9be-ad9f6e3d56de None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:33.070188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:33.071344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.071792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.072211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] PATH_INFO: `/v3/users/1e98026146cc46b4a469faae898abdab` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.073569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1e98026146cc46b4a469faae898abdab)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:33.075202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:33.077296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 144/284] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:32 2022] GET /identity/v3/users/1e98026146cc46b4a469faae898abdab => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:33.082391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:33.189706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9c400-c4a8-4f48-9da2-97def5afbacb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:33.235406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:33.236513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.236945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.237474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.243111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:33.244746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5c4fa-bfbd-4da3-9bcc-86de5389bd20 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:33.246962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 141/285] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:33 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:33.252535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:33.380616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8dd43-2717-43b6-8c1a-aeb92bf4d7d7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:33.413710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:33.414862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.415315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.415732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/1e98026146cc46b4a469faae898abdab/roles/23ad73e871854ab0af6f973f0ca5674c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.417883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, user_id=1e98026146cc46b4a469faae898abdab, role_id=23ad73e871854ab0af6f973f0ca5674c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:33.419585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be782-e8c9-4596-a13d-c7b23243b405 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:33.437801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 145/286] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:42:33 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/users/1e98026146cc46b4a469faae898abdab/roles/23ad73e871854ab0af6f973f0ca5674c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:42:33.476538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d56b-220c-45f9-8f14-1c08505ce84a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.476882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d56b-220c-45f9-8f14-1c08505ce84a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.477083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d56b-220c-45f9-8f14-1c08505ce84a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.480296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 142/287] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:33.486138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.486480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.486752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.506180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:33.507446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:33.589953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 146/288] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:33.613702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25d56b-220c-45f9-8f14-1c08505ce84a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:33.742696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25d56b-220c-45f9-8f14-1c08505ce84a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:33.776934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:33.777723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.778008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.778283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.789180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:33.796840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:33.797727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:33.798541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 143/289] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:33.807403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:33.935798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33a18-7f60-45e4-9066-94f4230411e9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:33.972101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:33.972772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:33.973057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:33.973329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:33.974169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:33.974498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:33.975950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:33.984534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 147/290] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:33.990082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:34.108233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185dfda-6094-4e14-b13a-e0a5c080148d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:34.157107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:34.157995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:34.158279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:34.158579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] PATH_INFO: `/v3/users/3df84a43c98647f9a3f33bd714171328` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:34.159815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] RBAC: Authorizing `identity:get_user(user_id=3df84a43c98647f9a3f33bd714171328)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:34.161373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:34.163106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 144/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:33 2022] GET /identity/v3/users/3df84a43c98647f9a3f33bd714171328 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:34.168558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:34.295459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a3374-7eb9-422f-803f-5ec9943351e2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:34.346493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:34.347159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:34.347447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:34.347729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:34.449734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:34.451243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:34.579590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 148/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:34.584825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:34.822166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9fe2c-7f7f-45e3-9141-1dc11f7897d7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:34.867485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:34.868705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:34.869183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:34.869649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:34.871075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:34.872739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847c896-6802-485e-a945-f054f7c5d0b7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:34.874978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 145/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:34 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:34.880765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.010294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91617-e63a-4aab-8acc-51248d95331d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.049915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.050607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.050895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.051175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.052049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=3df84a43c98647f9a3f33bd714171328) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:35.052369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:35.053827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07295b0b-b7e9-40ef-b729-c3785aacd0db None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:35.060884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 149/294] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:34 2022] GET /identity/v3/role_assignments?user.id=3df84a43c98647f9a3f33bd714171328&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c6aede8225634ab38adb58c045afc716 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:35.290135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d533-48eb-46c1-9f83-2da1cecb5896 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.291226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d533-48eb-46c1-9f83-2da1cecb5896 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.291733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066d533-48eb-46c1-9f83-2da1cecb5896 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.293676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 146/295] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:35.299305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.299603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.299889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.325487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:35.326257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7e0f-a183-4478-91eb-3a2d66d5d771 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.326750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:35.326990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7e0f-a183-4478-91eb-3a2d66d5d771 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.327461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a7e0f-a183-4478-91eb-3a2d66d5d771 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.329466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 147/296] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:35.335901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442350c7-7ac9-4173-b236-e32727442537 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.336517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442350c7-7ac9-4173-b236-e32727442537 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.336994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442350c7-7ac9-4173-b236-e32727442537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.358367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-442350c7-7ac9-4173-b236-e32727442537 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:35.359970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-442350c7-7ac9-4173-b236-e32727442537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:35.414815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 150/297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:35.438757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.468924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 148/298] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:35.498583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442350c7-7ac9-4173-b236-e32727442537 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.553388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68dcb7-a3d1-4900-bbc5-8b466f7a3282 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.602883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.603684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.604415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.604703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.617752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:35.632022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442350c7-7ac9-4173-b236-e32727442537 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-3e664fc6-c0a5-4ec0-bfdc-b090ecaa7b0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:35.632194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:35.633036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:35.634356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 151/299] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:35.637805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1e38-834b-444c-a6d3-7f70cf7d108d None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.637805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1e38-834b-444c-a6d3-7f70cf7d108d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.637805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1e38-834b-444c-a6d3-7f70cf7d108d None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.637805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 152/300] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:35.640483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1e38-834b-444c-a6d3-7f70cf7d108d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.669424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.670210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.670500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.670795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.681362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c9b02878-2cdd-47a4-a143-dfe131f4b888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:35.689214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:35.690084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:35.690917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 149/301] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:35.692424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.693133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.693417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.715923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:35.717121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:35.750496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1e38-834b-444c-a6d3-7f70cf7d108d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.784534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.785206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.785491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.785773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.786676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:35.786981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:35.788892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:35.793946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 150/302] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:35.800261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 153/303] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:35.801348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.803553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.901123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d63dc-b077-4048-88a9-a42b8dc252e2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.909349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194959-dbf2-43eb-9db0-9f2d6c5170b8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:35.935314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.936273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.936741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.937221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.938145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:35.938632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:35.940159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:35.943324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:35.945421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:35.945700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:35.945974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] PATH_INFO: `/v3/users/f08e7acd300549d6a13634326620b2a3` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:35.950340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 154/304] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:35.951312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:35.959341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] RBAC: Authorizing `identity:get_user(user_id=f08e7acd300549d6a13634326620b2a3)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:35.960828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:35.962545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 151/305] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/users/f08e7acd300549d6a13634326620b2a3 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:35.963737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.058251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0df415-16e8-4c52-958e-18d291d584f9 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.059469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9888087-40cc-4c1e-a2db-7843ded0ef38 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.091486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93692119-9217-4748-858a-f7134de64b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.092265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692119-9217-4748-858a-f7134de64b86 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.092549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692119-9217-4748-858a-f7134de64b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.092823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692119-9217-4748-858a-f7134de64b86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.093452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.093992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93692119-9217-4748-858a-f7134de64b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.094317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.094628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.094902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] PATH_INFO: `/v3/users/955b1e148d1143168d7ac41caa3a4b17` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.095465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93692119-9217-4748-858a-f7134de64b86 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.096096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] RBAC: Authorizing `identity:get_user(user_id=955b1e148d1143168d7ac41caa3a4b17)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.097091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 155/306] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:36.097851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93692119-9217-4748-858a-f7134de64b86 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.102660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.108822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 152/307] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:35 2022] GET /identity/v3/users/955b1e148d1143168d7ac41caa3a4b17 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:36.108822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.200418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93692119-9217-4748-858a-f7134de64b86 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.213946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ac6b5-368d-495f-af0e-78dbf47b0a3c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.236215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.237188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.237474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.237753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.238619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, user.id=f08e7acd300549d6a13634326620b2a3, scope.system=all) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:36.238936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.240963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.254489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 156/308] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 19:42:36 2022] GET /identity/v3/role_assignments?user.id=f08e7acd300549d6a13634326620b2a3&scope.system=all&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:36.254489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.256472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.257236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.257586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.257950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] PATH_INFO: `/v3/groups` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.258773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.260312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7560b3-234b-42da-8297-3427ff9af55d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.281181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 153/309] 10.222.0.57 () {60 vars in 1134 bytes} [Tue May 10 19:42:36 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:36.377722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e7d6-bfc5-4768-b138-fbb90bdb45f4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.383574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c88-0c74-456f-a6a9-dae7c03318fe None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.384101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c88-0c74-456f-a6a9-dae7c03318fe None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.384101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0c88-0c74-456f-a6a9-dae7c03318fe None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.390015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 154/310] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:36.391898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.392191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.392474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.414644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:36.415958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:36.417870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.418857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.419149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.419438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] PATH_INFO: `/v3/system/users/955b1e148d1143168d7ac41caa3a4b17/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.421176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=955b1e148d1143168d7ac41caa3a4b17, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.422771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.434136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 157/311] 10.222.0.57 () {58 vars in 1334 bytes} [Tue May 10 19:42:36 2022] PUT /identity/v3/system/users/955b1e148d1143168d7ac41caa3a4b17/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:36.511617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 155/312] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:36.542480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.653891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52a8de-9562-49bc-953a-7321de2d610a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.688161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.688964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.689246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.689516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.700113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:36.707792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:36.709233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:36.710028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 158/313] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:36.715535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.814283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebd10f-a824-4c3b-a61a-de7af1260403 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:36.849432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:36.850103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:36.850381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:36.850683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:36.851436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:36.851747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:36.853124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:36.861637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 156/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:36.867363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:36.968123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487477e-fca8-4d24-bae2-65372c8d4fb6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:37.003002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:37.003885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:37.004171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:37.004449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] PATH_INFO: `/v3/users/1e98026146cc46b4a469faae898abdab` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:37.006199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=1e98026146cc46b4a469faae898abdab)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:37.007683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:37.009611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 159/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:36 2022] GET /identity/v3/users/1e98026146cc46b4a469faae898abdab => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:37.015547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:37.118157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d40ba-c701-43a1-8905-2ba4c09090e5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:37.152742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:37.153390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:37.153670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:37.153944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:37.222053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:37.223658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:37.321950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 157/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:37.327738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:37.427637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b27b4-9f50-4538-8a23-7ced0a3fc9a0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:37.463885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:37.464746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:37.465033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:37.465314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:37.466782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:37.468348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a799e-1dcc-4886-9b58-612f0c9a9179 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:37.470061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 160/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:37 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:37.475957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:37.593646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5f0de-9bf9-4c3b-9c38-0c3351a73f5b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:37.629674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:37.630937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:37.631220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:37.631496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:37.632330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a, user.id=1e98026146cc46b4a469faae898abdab) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:37.632637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:37.634086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f5df6-857d-4046-8c9b-e8db74195362 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:37.640210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 158/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:42:37 2022] GET /identity/v3/role_assignments?user.id=1e98026146cc46b4a469faae898abdab&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:38.588940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273d1b-f803-4b02-85a6-af9f0f25e8a1 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.589464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273d1b-f803-4b02-85a6-af9f0f25e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.589464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273d1b-f803-4b02-85a6-af9f0f25e8a1 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.590936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 161/319] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:38.596043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.596410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.596598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.613286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:38.614555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:38.669473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516272d-55e1-4c38-bf06-76e6ce79de82 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.669804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516272d-55e1-4c38-bf06-76e6ce79de82 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.670037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516272d-55e1-4c38-bf06-76e6ce79de82 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.671465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 162/320] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:38.676368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20469ec-2e1f-49fc-9928-fe307cb895f9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.677185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20469ec-2e1f-49fc-9928-fe307cb895f9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.677463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20469ec-2e1f-49fc-9928-fe307cb895f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.679210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 159/321] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:38.693565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c20469ec-2e1f-49fc-9928-fe307cb895f9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:38.694772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c20469ec-2e1f-49fc-9928-fe307cb895f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:38.701138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:38.759269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 163/322] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:38.760526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff6aa-5f78-48d4-89f4-072a1e3e7623 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.761808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff6aa-5f78-48d4-89f4-072a1e3e7623 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.761808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ff6aa-5f78-48d4-89f4-072a1e3e7623 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.762776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 164/323] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:38.767542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.767832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.768114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.784585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:38.785995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:38.807610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eddb5b-9219-4877-8489-278ffe80f38d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:38.839394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:38.840178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.840458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.840726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.849750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 165/324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:38.850713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:38.851524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:38.859146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:38.860005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:38.860800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:38.866356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:38.948258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38435cc-3e91-4371-b738-c0af41b14694 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:38.959186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf3af-c8e0-4948-a2d9-a99ca5e0998e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:38.980510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:38.981291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.981575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.981850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.983100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:38.984550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:38.986423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 166/326] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:38.987003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:38.991787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:38.992443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:38.992725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:38.993002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:38.993750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:38.994059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:38.995444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.008679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:39.008679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.085055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0d6d9-4f75-4de0-bed0-28cd25ecaba2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.100027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f26c-b05b-4d4a-87e9-ae2a0f53c2c6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.119842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.120646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.120936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.121208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.131939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:39.133555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.134208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.134515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.134794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] PATH_INFO: `/v3/groups` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.135472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.136904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:39.139610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:39.140464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 167/328] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:39.141570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.152490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 162/329] 10.222.0.57 () {60 vars in 1134 bytes} [Tue May 10 19:42:39 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:39.153310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.251681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd02f-3287-49f0-8b52-a809b23a829b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.259833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f643a4-d10b-4c8b-a84b-3dea3f6509e1 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.290547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.291442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.291726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.292004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] PATH_INFO: `/v3/users/f08e7acd300549d6a13634326620b2a3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.293244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f08e7acd300549d6a13634326620b2a3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.294676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.294812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.295367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.295651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.295927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.296646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 168/330] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:39 2022] GET /identity/v3/users/f08e7acd300549d6a13634326620b2a3 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:39.296748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:39.296991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.298390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.302315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.308104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 163/331] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:39.313601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.406957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4603-59e4-4d3b-9362-873224a753d1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.429472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b4e7-567c-4594-bfb6-b7c099c271fd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.445238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.446280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.446617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.447244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] PATH_INFO: `/v3/system/users/f08e7acd300549d6a13634326620b2a3/roles/23ad73e871854ab0af6f973f0ca5674c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.449519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f08e7acd300549d6a13634326620b2a3, role_id=23ad73e871854ab0af6f973f0ca5674c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.451014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.458697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 169/332] 10.222.0.57 () {58 vars in 1334 bytes} [Tue May 10 19:42:39 2022] PUT /identity/v3/system/users/f08e7acd300549d6a13634326620b2a3/roles/23ad73e871854ab0af6f973f0ca5674c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:42:39.467713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.469105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.469594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.470109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] PATH_INFO: `/v3/users/955b1e148d1143168d7ac41caa3a4b17` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.471819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=955b1e148d1143168d7ac41caa3a4b17)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.473717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34cce8-efc0-4cf1-8918-7fb0f5267bc6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.476224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 164/333] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:39 2022] GET /identity/v3/users/955b1e148d1143168d7ac41caa3a4b17 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:39.482128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:39.600028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b87f-f0d4-4191-81a8-cf5f22941256 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:39.638017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:39.639078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:39.639597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:39.640088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:39.640947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] RBAC: Adding query filter params (role.id=c6aede8225634ab38adb58c045afc716, user.id=955b1e148d1143168d7ac41caa3a4b17, scope.system=all) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:39.641265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:39.642858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216cdd-4d61-4f66-b686-f68177d0b7cd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:39.656586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 170/334] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 19:42:39 2022] GET /identity/v3/role_assignments?user.id=955b1e148d1143168d7ac41caa3a4b17&scope.system=all&role.id=c6aede8225634ab38adb58c045afc716 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:41.727397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178b37-aab2-43f3-80db-2ef0696d5672 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:41.728431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178b37-aab2-43f3-80db-2ef0696d5672 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:41.729209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178b37-aab2-43f3-80db-2ef0696d5672 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:41.731415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 165/335] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:41.749132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5294e-6456-4bea-ad96-fdbec9119b99 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:41.750083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5294e-6456-4bea-ad96-fdbec9119b99 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:41.750596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5294e-6456-4bea-ad96-fdbec9119b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:41.772729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c3d5294e-6456-4bea-ad96-fdbec9119b99 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:41.774271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c3d5294e-6456-4bea-ad96-fdbec9119b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:41.852916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 171/336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:41.893716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178b37-aab2-43f3-80db-2ef0696d5672 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:41.925659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832480d7-277a-4225-8977-a88a6a123932 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:41.926275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832480d7-277a-4225-8977-a88a6a123932 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:41.927416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832480d7-277a-4225-8977-a88a6a123932 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:41.929273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 172/337] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:41.934765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:41.935292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:41.935760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:41.962329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:41.963552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:42.055178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 173/338] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:42.062030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178b37-aab2-43f3-80db-2ef0696d5672 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.105972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.107514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.108317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.108599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.108883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.120353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:42.128535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:42.129429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:42.130831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:42.133007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 166/339] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:42.139088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.282841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cb1a-c8ba-40b1-991f-d184ab31817a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.334759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf5261-8c2d-43db-b373-267bc9b51405 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.341877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.342716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.342999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.343271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.363469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:42.376290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:42.377202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:42.378432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 174/340] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:42.384628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.411917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85451f39-9744-4174-a652-83df71155885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.412599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85451f39-9744-4174-a652-83df71155885 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.412886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85451f39-9744-4174-a652-83df71155885 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.413236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85451f39-9744-4174-a652-83df71155885 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.413997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85451f39-9744-4174-a652-83df71155885 None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:42.414308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85451f39-9744-4174-a652-83df71155885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:42.415730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85451f39-9744-4174-a652-83df71155885 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:42.435780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 167/341] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:42.440945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85451f39-9744-4174-a652-83df71155885 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.526497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780446f-2dae-4d91-8ca5-55e65c9b42dd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.566029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.566893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.567780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.568101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.568858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:42.569161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:42.570578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d68645-b33a-4a74-a52b-744dd2706faa None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:42.585365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 175/342] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:42.588046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6a9d-3ee4-45ac-88e8-f2b6edd562ae None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.588332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6a9d-3ee4-45ac-88e8-f2b6edd562ae None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.588608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6a9d-3ee4-45ac-88e8-f2b6edd562ae None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.589977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 176/343] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:42.590558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6a9d-3ee4-45ac-88e8-f2b6edd562ae None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.662826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85451f39-9744-4174-a652-83df71155885 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.702157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.703101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.703528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.703946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.764580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6a9d-3ee4-45ac-88e8-f2b6edd562ae None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:42.779221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:42.781261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee086ab-84a8-4fa1-8646-fb1b666c79e3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:42.799139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:42.800035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.800468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.800907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.868818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:42.870577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:42.881688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 168/344] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:42:42.883269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177869e-0748-4e12-9c71-790dfa44d158 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.883700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177869e-0748-4e12-9c71-790dfa44d158 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.884146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177869e-0748-4e12-9c71-790dfa44d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.900313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b177869e-0748-4e12-9c71-790dfa44d158 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:42.901685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b177869e-0748-4e12-9c71-790dfa44d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:42.969845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 169/345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:42.970972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 177/346] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:42.971341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451a0-2350-4be7-bc3a-0768c6db2c5d None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:42.971636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451a0-2350-4be7-bc3a-0768c6db2c5d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:42.971822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:42.971920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994451a0-2350-4be7-bc3a-0768c6db2c5d None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:42.973980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 170/347] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:42.979102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994451a0-2350-4be7-bc3a-0768c6db2c5d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.084686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc7242-27ae-4148-a2a4-100e877e7746 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.087004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994451a0-2350-4be7-bc3a-0768c6db2c5d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.121901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.122386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.123230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.123346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.123548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.123818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.124039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.124466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.125020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.126232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.126876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29994-ec4d-4b49-8a01-a40fdc969e12 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.128021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.128917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 171/348] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.130665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 178/349] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:42 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.131116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.131541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.131948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.132072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.149835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:43.151032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:43.226653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 172/350] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:43.227503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.241845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eca8c-be71-4b64-97a0-a1c86803cbb1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.278309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.279399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.279838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.280264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.291261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:43.299433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:43.300599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 19:42:43.302098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:43.304970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 179/351] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:43.306004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.347896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b9a3-6026-4280-8d51-bf80cc0972b6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.382684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.383803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.384252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.384674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.390874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.392519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.394711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 173/352] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.395747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.410548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d76f2-89c0-45a2-afe0-aa5585ebc7e4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.445558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.446632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.447019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.447441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.448774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.450340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.452199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 180/353] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.453040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.498559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0adba-1c71-42f3-ab33-d81aaf247c92 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.533268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.534327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.534792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.535770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.546559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:43.554656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:43.555584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:43.556360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:43.558954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 174/354] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:43.563679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.564142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e145e-bb9a-48b2-9067-d0b2aeff2bbd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.603907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.604681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.605042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.605393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.606243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:43.606654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.608107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.619807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 181/355] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.620924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.676115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277fdf5-8175-4c61-88d8-f712cf27f34d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.712073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.713096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.713693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.714188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.715259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:43.715769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.717423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.723385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 175/356] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c6aede8225634ab38adb58c045afc716 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.724570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.724688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593433-cb5e-4ebe-a1b8-4395ad254be3 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.769486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.771572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.772042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.772474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.773772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:43.774314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.776030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.782781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 182/357] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.784034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.888708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad38b9-91b1-460a-8012-f4367fd5a30c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.938955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.939635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.939915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.940191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.940955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:43.941260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.945007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ca0d8-5d6a-498a-a546-edfe73fb492e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:43.947030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf018ad-ec86-423b-b832-652b773ec218 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.956631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 176/358] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.958928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9ff1-8f47-4d1c-9dda-43bfc7b11c4a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.959386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9ff1-8f47-4d1c-9dda-43bfc7b11c4a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.959528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9ff1-8f47-4d1c-9dda-43bfc7b11c4a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.960830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 177/359] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:43.967534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b9ff1-8f47-4d1c-9dda-43bfc7b11c4a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:43.988410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:43.990219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.990747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.991267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] PATH_INFO: `/v3/users/f08e7acd300549d6a13634326620b2a3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:43.992728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] RBAC: Authorizing `identity:get_user(user_id=f08e7acd300549d6a13634326620b2a3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:43.994480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58766-c94e-4ec4-b6f8-b52648b50d02 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:43.996573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 183/360] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/users/f08e7acd300549d6a13634326620b2a3 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:43.998169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:43.998715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:43.999210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.017699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:44.019375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:44.096218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b9ff1-8f47-4d1c-9dda-43bfc7b11c4a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.096608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 184/361] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:44.097126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.158818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.159486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.159767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.160040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.207550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ea72-1ab7-41e0-9bdf-1ff10d13579c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.245003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.245675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.245958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.246237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.247197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] RBAC: Adding query filter params (role.id=23ad73e871854ab0af6f973f0ca5674c, user.id=f08e7acd300549d6a13634326620b2a3, scope.system=all) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:44.247515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:44.249027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:44.262837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 185/362] 10.222.0.57 () {56 vars in 1308 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/role_assignments?user.id=f08e7acd300549d6a13634326620b2a3&scope.system=all&role.id=23ad73e871854ab0af6f973f0ca5674c => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:44.263702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.290496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:44.291995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1103-adea-4970-b18e-b92e92063f46 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:44.395467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a716d2a-b5d3-46cb-9e01-9e354eb5becf None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.462526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 178/363] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:44.465034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb35e-5ce0-4e79-8a09-a4990e7f4366 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.465620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb35e-5ce0-4e79-8a09-a4990e7f4366 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.466096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb35e-5ce0-4e79-8a09-a4990e7f4366 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.467735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 179/364] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:44.472370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cb35e-5ce0-4e79-8a09-a4990e7f4366 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.475844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.476767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.476963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.477238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.515464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-de665d83-383a-4982-923e-c713cc86cdee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:44.524479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:44.525413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:44.526892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 186/365] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:44.532095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee24988-072e-4717-af03-a04aca70d24f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.532652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee24988-072e-4717-af03-a04aca70d24f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.533139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee24988-072e-4717-af03-a04aca70d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.552296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-eee24988-072e-4717-af03-a04aca70d24f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:44.553849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-eee24988-072e-4717-af03-a04aca70d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:44.606879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cb35e-5ce0-4e79-8a09-a4990e7f4366 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.637729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 187/366] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:44.639336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee24988-072e-4717-af03-a04aca70d24f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.655637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.656843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.657343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.657820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.667803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:44.669057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:44.674183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 180/367] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:44.674183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.808230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b85c2-76d8-435a-9109-077220e52e70 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.810034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee24988-072e-4717-af03-a04aca70d24f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.848838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.850110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.850632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.851115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.854555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:44.855317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:44.855619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:44.855886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:44.856656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:44.856964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:44.858350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:44.867174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:44.869012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 188/368] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:44.869673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:44.878963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:44.879974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:44.880763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:44.883255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 181/369] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:44.884256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:44.995819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d28a-8ff9-4098-be60-347c4a485f63 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:44.996459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83824f6-831c-4cb4-8cb6-4d99aee2368c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.033616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632178c-4d36-4980-bd79-074e723369da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.034884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632178c-4d36-4980-bd79-074e723369da None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.035466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632178c-4d36-4980-bd79-074e723369da None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.036650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632178c-4d36-4980-bd79-074e723369da None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.038095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632178c-4d36-4980-bd79-074e723369da None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.038217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.038973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.039263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.039544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.040773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632178c-4d36-4980-bd79-074e723369da None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.042972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 189/370] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.043973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632178c-4d36-4980-bd79-074e723369da None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.125626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.127736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.168231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632178c-4d36-4980-bd79-074e723369da None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.209814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.211401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.211701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.211981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.212747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:45.213057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.214522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.224103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 190/371] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.224999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.241886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 182/372] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:45.243120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.327219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397c923-55f9-4a5d-bf23-dbb0847ff795 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.344535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55cc16-e164-4bc0-ac57-041a03b47d3a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.362385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.362892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.363180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.363465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.364343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:45.364661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.366132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.372352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 191/373] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c6aede8225634ab38adb58c045afc716 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.373170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.382169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.383235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.383716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.384214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.458730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.460662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.533759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6250-1341-4f20-8e71-90150642ff29 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.583347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 183/374] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:45.589008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.590002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.590913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.591203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.591487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.595311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.596804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.598992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 192/375] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.604438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.698642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a92e-30a5-45ab-a2c0-83e2b2be908a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.716498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeba5a-c00c-4c9e-80fa-059b54851306 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.734916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.736204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.736687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.737269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] PATH_INFO: `/v3/projects/f00ba0ca569547899fe0f1c352883756` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.739882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] RBAC: Authorizing `identity:get_project(project_id=f00ba0ca569547899fe0f1c352883756)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.741638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.743963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 184/376] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/projects/f00ba0ca569547899fe0f1c352883756 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.750030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.760698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.761965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.762485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.763093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.765759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.767619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.770857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 193/377] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:45.779499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.906647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9ebe-e2cd-4d6c-bba5-4b61ab9a6e60 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.922645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83ba30-df3a-4f84-8d1a-d9c8d91a3aa2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:45.949677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.951231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.951719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.952192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] PATH_INFO: `/v3/groups/8625fdb21c864787beef921e9e01bfd8` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.957973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] RBAC: Authorizing `identity:get_group(group_id=8625fdb21c864787beef921e9e01bfd8)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.960058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:45.962418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 185/378] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/groups/8625fdb21c864787beef921e9e01bfd8 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:45.967911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:45.988400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:45.990072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:45.992871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:45.993378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:45.994702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:45.996759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:45.998422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2298b-e853-4920-aa59-2c8cadd80bb8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:46.012481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 194/379] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:46.097779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d579dc-ab4e-4961-b8fd-45321d431d21 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:46.135853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:46.136933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.137427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.137897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.139059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] RBAC: Adding query filter params (group.id=8625fdb21c864787beef921e9e01bfd8, role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=f00ba0ca569547899fe0f1c352883756) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:46.139583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:46.141339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea2b7b-1830-49a5-a441-17ccc48b8a20 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:46.148778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 186/380] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:45 2022] GET /identity/v3/role_assignments?group.id=8625fdb21c864787beef921e9e01bfd8&scope.project.id=f00ba0ca569547899fe0f1c352883756&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:46.474826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ff55c-74b4-4e9d-b88a-2de300404db1 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.475521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ff55c-74b4-4e9d-b88a-2de300404db1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.476026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ff55c-74b4-4e9d-b88a-2de300404db1 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.477852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 195/381] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:46.484168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb933d-5d93-4945-ae4e-0e99f179191a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.484741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb933d-5d93-4945-ae4e-0e99f179191a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.485242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb933d-5d93-4945-ae4e-0e99f179191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.504077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3deb933d-5d93-4945-ae4e-0e99f179191a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:46.506153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3deb933d-5d93-4945-ae4e-0e99f179191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:46.591908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 187/382] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:46.614544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ff55c-74b4-4e9d-b88a-2de300404db1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:46.718679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ff55c-74b4-4e9d-b88a-2de300404db1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:46.737696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce536a-973e-4385-b7ac-a9396c2f3381 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.738276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce536a-973e-4385-b7ac-a9396c2f3381 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.738793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce536a-973e-4385-b7ac-a9396c2f3381 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.741754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 188/383] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:46.747275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.747825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.748319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.765997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:46.766618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:46.766838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.767132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.767417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.768778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:46.788195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:46.800157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:46.801117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:46.801987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 196/384] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:46.824795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:46.900214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 189/385] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:46.937270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ffcdc-aa47-415d-bccd-5d6cc7e02b65 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:46.949228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:46.978321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:46.979307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:46.980515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:46.980940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:46.982010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:46.983642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:46.985940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:46.998427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 197/386] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:47.004297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.111845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852099-5140-4ae8-89d9-09d4ad813e4a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.161563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.162383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.162694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.162967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.183798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:47.191912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:47.193562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:47.194358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:47.195823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 190/387] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:47.206196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24a3b3-01ff-4516-b25b-72de7792b674 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.210706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.275867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.276709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.277005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.277276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.283185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.284729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.286690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 198/388] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:47 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:47.295991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.413153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1c66d-b0ba-4ad2-91f5-97b23d60d5f0 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.459503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f678a2-043a-445d-a573-b66fb2fa5854 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.508141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.509394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.509892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.510371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.512302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.514504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.516910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 199/389] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:47 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:47.523177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.524142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.524644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.525129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.527119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.527499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:47.528009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.529950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.550570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 191/390] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:47.553896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.670788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75894ac-969b-4384-8729-eddaae6abf0e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.711565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92868adf-2d8d-4113-a0f5-f449651aca2a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.723696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.724609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.724908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.725189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/groups/655923b274104c83b111f5349587d093/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.728425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, group_id=655923b274104c83b111f5349587d093, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.730784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.751367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 200/391] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 19:42:47 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/groups/655923b274104c83b111f5349587d093/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:47.765226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.766661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.767195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.767704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.769404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.771770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.774102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 192/392] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:47 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:47.779875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:47.892896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a452b-7c90-48b5-85f2-c4fb17b60e0d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:47.940530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:47.942272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:47.942783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:47.943324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:47.947217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:47.948984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce40108-bab0-4bad-8c96-db8ddd4a6166 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:47.951099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 201/393] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:47 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:47.957058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:48.070304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc21f2-6f35-4c1b-b397-d73fb664d178 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:48.106814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:48.108099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:48.108597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:48.109069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/groups/655923b274104c83b111f5349587d093/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:48.111596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab1b4e437074ecea93fcdf2f784524a, group_id=655923b274104c83b111f5349587d093, role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:48.113289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270949c-9c37-44e3-ad3f-e24e74b73e53 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:48.129881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 193/394] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 19:42:47 2022] PUT /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a/groups/655923b274104c83b111f5349587d093/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:48.872283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec2106-efb8-429c-bf95-c91b3e8d6ea6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:48.872895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec2106-efb8-429c-bf95-c91b3e8d6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:48.873401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec2106-efb8-429c-bf95-c91b3e8d6ea6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:48.875277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 202/395] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:48.881263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05ac1-3597-4f83-a07c-902d7092c1fb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:48.881819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05ac1-3597-4f83-a07c-902d7092c1fb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:48.882294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05ac1-3597-4f83-a07c-902d7092c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:48.904184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-08f05ac1-3597-4f83-a07c-902d7092c1fb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:48.905734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-08f05ac1-3597-4f83-a07c-902d7092c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:48.988247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 194/396] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:49.023915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec2106-efb8-429c-bf95-c91b3e8d6ea6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.060512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f5c9-4be7-4d4b-8c05-ccbea421e86c None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.061161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f5c9-4be7-4d4b-8c05-ccbea421e86c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.061631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f5c9-4be7-4d4b-8c05-ccbea421e86c None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.063633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 195/397] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:49.069013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.069311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.069589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.095287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:49.096528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:49.199193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec2106-efb8-429c-bf95-c91b3e8d6ea6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.203501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 196/398] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:49.240862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.241691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.241972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.242248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.255447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.258040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:49.265774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:49.266710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:49.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:49.270561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 203/399] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:49.273519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.370335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282998-4a9b-44e2-b5b5-5f82bed58ebe None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.417724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.418375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb028d6-f07b-49ac-833b-2a42210c4f53 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.419000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.419489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.420166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.434517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-202f575d-b3c7-4a6b-aa9b-9b478f524cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:49.447251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:49.448178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:49.448973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:49.451919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 197/400] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:49.453561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec973-f942-4ce7-bff1-79898af59ce1 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.454325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec973-f942-4ce7-bff1-79898af59ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.454902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec973-f942-4ce7-bff1-79898af59ce1 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.459646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.459798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.460185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.460573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.461423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] RBAC: Adding query filter params (name=member) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:49.461786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 198/401] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:49.461895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:49.462773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec973-f942-4ce7-bff1-79898af59ce1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.464423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee4d10-fb03-4266-813d-ec303c3d8ffb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:49.477406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 204/402] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:49.478911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.479308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.479687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.501578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:49.502929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:49.579611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 205/403] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:49.580745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.589223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec973-f942-4ce7-bff1-79898af59ce1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.631679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.632495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.633101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.633219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.634078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:49.634503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:49.636029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:49.646923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 199/404] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:49.647928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.708165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcd976-054a-4b26-adc1-35ee969f44b2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.758331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.759508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.759941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.760395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.763582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:49.765217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:49.767367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 206/405] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:49.768288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.776410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098895d-b198-4a61-b5f2-2bc6e4f8f908 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.821763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.822862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.823292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.823713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.836283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:49.847471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:49.848645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:49.849616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:49.854941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 200/406] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:49.854941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.897487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81481a1-1dc6-4abf-a27a-6517bb065a34 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:49.941922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:49.943337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:49.943623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:49.943901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] PATH_INFO: `/v3/groups/8625fdb21c864787beef921e9e01bfd8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:49.945105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] RBAC: Authorizing `identity:get_group(group_id=8625fdb21c864787beef921e9e01bfd8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:49.946592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:49.948535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 207/407] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/groups/8625fdb21c864787beef921e9e01bfd8 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:49.949335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:49.982172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6327d6-a250-4dca-a543-60d5bcdb38cb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.025215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.026510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.027450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.027881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.029549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.032141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.034313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 201/408] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:50.035270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.068988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4051-54d5-4a34-965f-aac374aebf46 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.109998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.111116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.111580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.112054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.112980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:50.113534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.115741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.124254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 208/409] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:50.125392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.157679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17cacf-f377-4da0-b21b-faf5deb1d35f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.206662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.208789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.209074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.209353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] PATH_INFO: `/v3/projects/f00ba0ca569547899fe0f1c352883756` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.210604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] RBAC: Authorizing `identity:get_project(project_id=f00ba0ca569547899fe0f1c352883756)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.212051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.214523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 202/410] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:50 2022] GET /identity/v3/projects/f00ba0ca569547899fe0f1c352883756 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:50.215303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.256220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857fc8-21ed-4925-a51d-e209ccd4c140 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.297311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff527838-d927-4335-815b-8824a059002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.299112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff527838-d927-4335-815b-8824a059002d None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.299895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff527838-d927-4335-815b-8824a059002d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.300404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff527838-d927-4335-815b-8824a059002d None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/groups/655923b274104c83b111f5349587d093/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.303902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff527838-d927-4335-815b-8824a059002d None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, group_id=655923b274104c83b111f5349587d093, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.306082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff527838-d927-4335-815b-8824a059002d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.334471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 209/411] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 19:42:50 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/groups/655923b274104c83b111f5349587d093/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:50.336150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff527838-d927-4335-815b-8824a059002d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.362266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60154a79-f563-4b67-9576-022dc629e841 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.442423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.443339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.443691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.444042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.451397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.452986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.455211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 203/412] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:50 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:50.461036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.470853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff527838-d927-4335-815b-8824a059002d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.516752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.517579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.518853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.519061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] PATH_INFO: `/v3/projects/f00ba0ca569547899fe0f1c352883756/groups/8625fdb21c864787beef921e9e01bfd8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.523553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] RBAC: Authorizing `identity:create_grant(project_id=f00ba0ca569547899fe0f1c352883756, group_id=8625fdb21c864787beef921e9e01bfd8, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.525065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ba9e3-266c-4698-9141-4fe9f07d0289 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.549870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 210/413] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 19:42:50 2022] PUT /identity/v3/projects/f00ba0ca569547899fe0f1c352883756/groups/8625fdb21c864787beef921e9e01bfd8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:42:50.581146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c66d-2f1b-4198-a6a5-d1f14a714c05 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.581460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c66d-2f1b-4198-a6a5-d1f14a714c05 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.581712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c66d-2f1b-4198-a6a5-d1f14a714c05 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.583686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 211/414] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:50.589384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.589673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.590933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.618630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:50.622891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:50.660344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c272c-a861-445d-aeb8-e1a95320f1f0 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.713473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.714351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.714714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.715005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.716291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.717759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.719940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 204/415] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:50 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:50.727460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.737440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 212/416] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:50.762335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:50.858226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f53ce-bb0d-420a-b92a-72dc4f1b9bfc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.896607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.897579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.897782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.898062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/groups/655923b274104c83b111f5349587d093/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.900370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] RBAC: Authorizing `identity:create_grant(project_id=948464c81ba04a5ebf01fcdf82caab0a, group_id=655923b274104c83b111f5349587d093, role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:50.901828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:50.907910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116693-da8a-4dd8-95e8-fd67f4e23eeb None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:50.930665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 205/417] 10.222.0.57 () {58 vars in 1442 bytes} [Tue May 10 19:42:50 2022] PUT /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a/groups/655923b274104c83b111f5349587d093/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:42:50.954429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:50.955572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:50.956024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:50.956437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:50.970891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-9d548a74-3690-4ea3-b173-7866ac36d1f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:50.979096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:50.980212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:50.981169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:50.988336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 213/418] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:50.994911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.026295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abed29-9706-42fd-801f-d8c19848955a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.026829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abed29-9706-42fd-801f-d8c19848955a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.027310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abed29-9706-42fd-801f-d8c19848955a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.029090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 214/419] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:51.053024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.053645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.054075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.087601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:51.089523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:51.120378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb904e41-f9a3-405e-a5c8-f10239f7885f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:51.161940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:51.164761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.164761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.164761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.164761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:51.164761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:51.165618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:51.180851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 206/420] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:51.185232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.191589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 215/421] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:42:51.240269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.297770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ec1a0-f348-4846-a498-cd7775cc2ee1 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:51.332594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:51.333580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.334075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.334605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.429490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ab636-ab8f-4f04-a270-90080dd5f263 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:51.449931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:51.451454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:51.494216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:51.495059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.495345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.495622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.515372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:51.530506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:51.531456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:51.532267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 216/422] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:51.535774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.628206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 207/423] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:42:51.631026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.745859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6422-ae76-430b-823d-1699aa98e41d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:51.786331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec2ba-e544-4853-8e0f-f16205f924ff None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:51.811202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:51.811886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.812175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.812457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.813215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:51.813523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:51.814953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:51.831626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 217/424] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:51.837532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:51.838970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:51.839835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:51.840119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:51.840397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:51.847218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:51.848727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:51.850828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 208/425] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:51.856583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:52.009831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c41c-6e31-4561-9bb5-2115201f2d29 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.024510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319d4c-9509-4c4a-98b0-23daf1eea58a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.077747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.078693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.079152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.079572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.079723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.080597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.080880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.081153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.087219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.088692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.090579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 209/426] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:52.096194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:52.151017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.153052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.252501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 218/427] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:42:52.258203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:52.296431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaac4b-3fd1-4a1a-8abd-3b1c3f0c5565 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.356919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399ffd9-20ee-4cfe-8597-d5b8b2632162 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.376408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.376957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.377199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.377474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.378330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:52.378666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.380235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.396313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.397413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.397856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.398272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] PATH_INFO: `/v3/projects/4ab1b4e437074ecea93fcdf2f784524a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.399638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] RBAC: Authorizing `identity:get_project(project_id=4ab1b4e437074ecea93fcdf2f784524a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.400966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 210/428] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:52 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c6aede8225634ab38adb58c045afc716 => generated 611 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:52.401497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.403614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 219/429] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:52 2022] GET /identity/v3/projects/4ab1b4e437074ecea93fcdf2f784524a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:52.409352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:52.547793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdc276-3fad-4f31-95dd-cf5d7db8b330 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.599357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.600250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.600532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.600813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.602158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.603664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a463b-8461-47ba-8143-8266f78af3c3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.605696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 211/430] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:52 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:52.611514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:52.753922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c586b43-3d26-4cc3-9faf-0f0e1f8f57db None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:52.790371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:52.791367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:52.791863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:52.792313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:52.793321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=4ab1b4e437074ecea93fcdf2f784524a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:52.793813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:52.795466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbe63-66c9-4bc1-8ccc-ba3f24c0ab17 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:52.802928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 220/431] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:52 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=4ab1b4e437074ecea93fcdf2f784524a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:53.169761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c74b3-6176-4536-9306-8c8890f78b61 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.169976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c74b3-6176-4536-9306-8c8890f78b61 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.170425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c74b3-6176-4536-9306-8c8890f78b61 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.172291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 212/432] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:53.178701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.179585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.180065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.192315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5fe-c4b3-4724-8af4-7b6ace3290f5 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.194270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5fe-c4b3-4724-8af4-7b6ace3290f5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.194270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5fe-c4b3-4724-8af4-7b6ace3290f5 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.194808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 213/433] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:53.198928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:53.200148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:53.200626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.201124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.201598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.221597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:53.223737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:53.277683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 221/434] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:53.301621 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.307877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 214/435] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:53.332734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.413315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dab46-4b9d-4e4b-bd9a-940142d73bf6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.454444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f970a68-177f-41f6-83b0-2e0a6bb525a6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.459359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.460183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.460471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.460750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.477993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:53.486241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:53.487233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:53.488026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 222/436] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:53.493553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.502444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.503293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.503576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.503850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] PATH_INFO: `/v3/roles/member` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.514779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:53.524529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:53.525423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 19:42:53.526229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:53.528691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 215/437] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:53.529550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.593743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b966f7-271b-4b3e-97b7-4744e2d84956 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.627081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.627277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977816dc-f7ca-44a2-ad23-9564df9857af None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.627754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.628039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.628317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.629065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:53.629905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:53.631374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:53.639742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 223/438] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:42:53.645988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.662182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.662880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.663164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.663443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.664183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] RBAC: Adding query filter params (name=member) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:53.664486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:53.665864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432b47-7c5e-44d5-9cca-080f9f813e9b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:53.674412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 216/439] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:53.675679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4bc2-0d38-40c9-ad59-deb6b8330136 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.675970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4bc2-0d38-40c9-ad59-deb6b8330136 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.676776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc4bc2-0d38-40c9-ad59-deb6b8330136 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.678168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 217/440] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:53.680355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc4bc2-0d38-40c9-ad59-deb6b8330136 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:53.741054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cc76-ca87-4c41-811f-d1215738aa0a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.772759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.773397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.773684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.773962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.774815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc4bc2-0d38-40c9-ad59-deb6b8330136 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:53.807064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:53.807695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.807980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.808259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.839087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:53.841178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b486c-6a5c-404f-8d8f-a0b722f7e113 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:53.873454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:53.874949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:53.939520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 224/441] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:53.939520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:53.939520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:53.939520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:53.953340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:53.954910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:53.971970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 218/442] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:53.972804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.020662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 225/443] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:54.021420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.069879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b54c1-9c48-4802-b0a8-101fd87b9a7e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.103343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.104179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.104463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.104738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] PATH_INFO: `/v3/projects/f00ba0ca569547899fe0f1c352883756` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.105940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] RBAC: Authorizing `identity:get_project(project_id=f00ba0ca569547899fe0f1c352883756)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.107425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.109115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 219/444] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:53 2022] GET /identity/v3/projects/f00ba0ca569547899fe0f1c352883756 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.109870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.117427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac2a39-eb79-4581-86a1-5964853aaeb7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.150396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.151279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.151563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.151839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.153014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.154447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.156159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 226/445] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.156939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.204847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f2e2a-9d92-4365-bbfd-31a06176c16a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.236794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.237896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.238416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.239495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.250599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:42:54.256619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee825f14-9452-454c-87d7-65afe44a7f74 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:42:54.258851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:54.259899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:54.260694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 220/446] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:54.261658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.290657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.291424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.291705 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.291973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] PATH_INFO: `/v3/groups/8625fdb21c864787beef921e9e01bfd8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.293155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] RBAC: Authorizing `identity:get_group(group_id=8625fdb21c864787beef921e9e01bfd8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.294647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.296252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 227/447] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/groups/8625fdb21c864787beef921e9e01bfd8 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.297007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.358329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d99a7-ca4b-4da4-9e1a-fffb9eaf04a2 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.390267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.390805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dc669-82ba-4611-91d7-82d223a56ea3 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.391134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.391419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.391695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.392869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.394309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.396501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 221/448] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.397263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.425187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.425851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.426137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.426406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.427182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:54.427490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.428863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.436507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 228/449] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.437287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.490499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33422d56-ab19-4cd8-b0e7-0fee6094b79c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.523164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.523804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.524085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.524360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.525178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] RBAC: Adding query filter params (group.id=8625fdb21c864787beef921e9e01bfd8, role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=f00ba0ca569547899fe0f1c352883756) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:54.525488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.526989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.532762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 222/450] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/role_assignments?group.id=8625fdb21c864787beef921e9e01bfd8&scope.project.id=f00ba0ca569547899fe0f1c352883756&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.533557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.537052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e05bf-5b21-4317-b5bc-63c225d43eee None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.576686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.577280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.577568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.577849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.578724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c6aede8225634ab38adb58c045afc716, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:54.579040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.580508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.598650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 229/451] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c6aede8225634ab38adb58c045afc716 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:54.657685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15cd67-dc94-42b4-8df1-6c25f49461e5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:54.695395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:54.696073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:54.696363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:54.696643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:54.773804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:54.775324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:54.875935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 223/452] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:42:54.882068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:54.981293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef7a3-575d-46e0-b165-f02d772fb93a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:55.013044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:55.013894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:55.014176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:55.014451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] PATH_INFO: `/v3/projects/948464c81ba04a5ebf01fcdf82caab0a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:55.015643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] RBAC: Authorizing `identity:get_project(project_id=948464c81ba04a5ebf01fcdf82caab0a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:55.017082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:55.018808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 230/453] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:42:54 2022] GET /identity/v3/projects/948464c81ba04a5ebf01fcdf82caab0a => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:55.024851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:55.117881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f489d-5049-43f8-8ac4-cc113f069ea9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:55.150417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:55.151208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:55.151488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:55.151762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] PATH_INFO: `/v3/groups/655923b274104c83b111f5349587d093` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:55.152905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] RBAC: Authorizing `identity:get_group(group_id=655923b274104c83b111f5349587d093)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:55.154338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e744d2-4199-4eae-a6fe-c1e2e71e6a92 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:55.155966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 224/454] 10.222.0.57 () {56 vars in 1180 bytes} [Tue May 10 19:42:55 2022] GET /identity/v3/groups/655923b274104c83b111f5349587d093 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:55.161685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:55.254917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f154-48c6-41f7-8c2f-9e72b307f021 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:55.285927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:55.286597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:55.286884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:55.287164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:55.287990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] RBAC: Adding query filter params (group.id=655923b274104c83b111f5349587d093, role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=948464c81ba04a5ebf01fcdf82caab0a) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:55.288305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:55.289735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6268b-7c32-4235-af10-1a0dbdd17583 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:55.295362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 231/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue May 10 19:42:55 2022] GET /identity/v3/role_assignments?group.id=655923b274104c83b111f5349587d093&scope.project.id=948464c81ba04a5ebf01fcdf82caab0a&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:58.168133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579ac56-52f7-43dd-b944-5996d97125a7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.169154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579ac56-52f7-43dd-b944-5996d97125a7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.169699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579ac56-52f7-43dd-b944-5996d97125a7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.171562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 225/456] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:58.177361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411657c-994b-41bf-b52d-e36111c41b3f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.177845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411657c-994b-41bf-b52d-e36111c41b3f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.177929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411657c-994b-41bf-b52d-e36111c41b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.195460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0411657c-994b-41bf-b52d-e36111c41b3f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:58.196637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0411657c-994b-41bf-b52d-e36111c41b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:58.274131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 232/457] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:58.310173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579ac56-52f7-43dd-b944-5996d97125a7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:58.386187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979136d5-7465-451b-84d4-c6bb7502ecc2 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.386896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979136d5-7465-451b-84d4-c6bb7502ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.387380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979136d5-7465-451b-84d4-c6bb7502ecc2 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.389203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 233/458] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:42:58.398741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5011-58b6-4399-acc2-842af4661152 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.399336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5011-58b6-4399-acc2-842af4661152 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.399842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5011-58b6-4399-acc2-842af4661152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.432519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-797c5011-58b6-4399-acc2-842af4661152 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:58.433647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-797c5011-58b6-4399-acc2-842af4661152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:58.497481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579ac56-52f7-43dd-b944-5996d97125a7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:58.558204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:58.559252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.559672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.560080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.574489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 234/459] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:58.578555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:58.580147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:42:58.606660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:58.607735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:58.608689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:42:58.608689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:42:58.608689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.608689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:58.610559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 226/460] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:58.616287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538569b-4e24-4458-9a67-1a115daba19e None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.616586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538569b-4e24-4458-9a67-1a115daba19e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.616867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538569b-4e24-4458-9a67-1a115daba19e None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.618569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 235/461] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:58.619932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:58.623791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.624040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.624319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.642137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:58.643661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:58.719425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 236/462] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:58.720880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:58.728469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80effe33-28ff-4e91-8930-2ca9c00eddd4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:58.768958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:58.770241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.770770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.771243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.772160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:58.772664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:58.774248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:58.786494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 227/463] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:58.791926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:58.848967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0944886-48e3-4610-bcfe-1f0fde28c6af None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:58.892708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:58.893518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.894100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.894378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.897544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350e10f-dc1a-4fac-99c9-ce009e9f5d52 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:58.907397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:58.909196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:58.933371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:42:58.933654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:58.934760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:58.935769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:42:58.935769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:42:58.935769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.935769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:58.936606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:58.937081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:58.937327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 237/464] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:58.937741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:58.938175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:58.950106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:58.952142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:42:58.969986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:58.971153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:58.972005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:42:58.972005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:42:58.972005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:58.972005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:58.974906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 228/465] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:58.975970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.046985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f77e12-fa58-4f68-8770-69c8434ca987 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.081830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.082584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.082874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.083157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.083863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.085329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.088982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad27f7-85c1-42ba-80d1-4f11e2590d50 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.114496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 238/466] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:58 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:59.114496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.141385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.142262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.143009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.143293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.144396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:59.145383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.147149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a444690-16cd-4ee0-bd57-309ba6cb903d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.165878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 229/467] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:59.167902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453c9-aaba-4853-93eb-ab1a53e6653f None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.168293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453c9-aaba-4853-93eb-ab1a53e6653f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.168833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453c9-aaba-4853-93eb-ab1a53e6653f None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.170824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 230/468] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:59.177355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.177724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.178172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.196479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:59.197704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:59.224470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395fd97-fd9c-472b-be4d-4a7a361cb5df None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.262047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.262842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.263127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.263405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.264203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:59.264517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.265946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.272696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 231/469] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:59.273619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.286353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 239/470] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:59.297997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.391842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908e4bf-c19a-485c-abba-2bb6e69e64b7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.412138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3866f-9914-4b00-9541-af0e9814edd6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.425492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.426197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.426496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.426847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.428173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.430092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.448897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.449691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.449977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.450253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.451369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 232/471] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:59.458634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.462929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.463262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-370b6ea8-a949-415e-a8cc-a87086f8fb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:42:59.482310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:42:59.483263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:42:59.484094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:42:59.484094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:42:59.484094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:42:59.484094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:42:59.484094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 240/472] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:42:59.485101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23282-4d93-463f-9838-39c709e79a42 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.485392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23282-4d93-463f-9838-39c709e79a42 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.485673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a23282-4d93-463f-9838-39c709e79a42 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.491337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 241/473] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:42:59.492324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a23282-4d93-463f-9838-39c709e79a42 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.576449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd7bc5-35c3-4fd8-8a58-f04f07198a0b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.611071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a23282-4d93-463f-9838-39c709e79a42 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.611834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.612511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.612790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.613059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.614015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.615617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180fa0d-2d17-4209-b706-2cdaa7e9d533 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.641961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 233/474] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:59.643772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.644290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.645359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.664901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:42:59.666583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:42:59.667307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.667983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.668266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.668538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.669277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:42:59.669583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.671021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.697317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 242/475] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:42:59.699414 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.764828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 234/476] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:42:59.789927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:42:59.826001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f70af-75c6-4493-9867-dc70dd699de3 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.866319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.867032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.867322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.867599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.868322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.869775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.894344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 243/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:42:59.907108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c18628-7f18-4e56-aadd-7f87551bdfcf None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:42:59.954639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:42:59.955327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:42:59.955613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:42:59.955893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:42:59.956670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:42:59.958194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:42:59.965704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.sql.core [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:42:59.965704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 19:42:59.965704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [parameters: {'id': 'e47d48c76f94442dbf915100741d32ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 19:42:59.965704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79896) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:42:59.983556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return ref.to_dict() May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:42:59.984491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application yield resource May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise self.value May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application session.commit() May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:42:59.985413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.flush() May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application compat.raise_( May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:42:59.986288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:42:59.987217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:42:59.988122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [parameters: {'id': 'e47d48c76f94442dbf915100741d32ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:42:59.989459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 19:42:59.990253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:42:59.993143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 235/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 19:42:59 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 19:42:59.993280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:00.115988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc7f9-4e7b-48ed-b682-6f3918178c6d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:00.151984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:00.152801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:00.153083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:00.153362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:00.163987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-0d64fc71-16d9-4042-ba68-5ae9dc4cd0a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:00.172060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:00.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:00.176851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 244/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:00.180105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:00.297130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a92-007a-4de3-a940-f3a7508f9bbf None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:00.332719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:00.333737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:00.334223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:00.334750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:00.335727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:00.336231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:00.337796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d240c-6b9c-4ce8-a8d8-ec24238c923c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:00.346976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 236/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:01.734708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ec11-5899-4cc7-b0d7-6a974d97f48a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:01.735704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ec11-5899-4cc7-b0d7-6a974d97f48a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:01.736221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ec11-5899-4cc7-b0d7-6a974d97f48a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:01.738012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 245/481] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:01.755391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:01.755875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:01.755952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:01.776823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:01.778045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:01.861068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 237/482] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:01.903423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ec11-5899-4cc7-b0d7-6a974d97f48a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.037789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ec11-5899-4cc7-b0d7-6a974d97f48a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.087870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.088696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.088985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.089267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.102604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-561761b3-a0fb-4560-a2fd-bcbace9e42a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:02.110345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:02.111357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:02.112157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 246/483] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:02.123586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.232010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74fbc4-6330-4b74-9ace-5a4364e73a6b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.272224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.272897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.273182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.273457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.274202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:02.274525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:02.276049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8922-8611-4b36-adbe-84e70b95267f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:02.284363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5c2c-fee8-42e4-9045-d83d9dcab1d9 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.284651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5c2c-fee8-42e4-9045-d83d9dcab1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.284922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 238/484] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:02.285025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5c2c-fee8-42e4-9045-d83d9dcab1d9 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.286593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 247/485] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:02.292051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.292264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5c2c-fee8-42e4-9045-d83d9dcab1d9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.292420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.292679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.315446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:02.317167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:02.396293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 239/486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:02.428151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.433002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5c2c-fee8-42e4-9045-d83d9dcab1d9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.472170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.473399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.474119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.474779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.489206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:02.491184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:02.510074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:02.511038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:02.511880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:02.511880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:02.511880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:02.511880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:02.514137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 248/487] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:02.538486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.566017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0cef3-4943-4c90-ad32-710cb8bada8d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.635539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.636335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.636615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.636888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.654687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:02.662321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:02.663247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:02.664028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:02.680524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 240/488] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:02.683556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.729420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c3f65-d505-4a82-8671-00be87c71cfd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.766328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.767258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.767361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.767583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.768327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:02.768638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:02.770656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda4a0f-18e0-4a20-89e5-e6a7cdce8ad3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:02.783971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 249/489] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:02.785478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882eb3-e5ca-4919-8d3a-2ed5e1580211 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.785769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882eb3-e5ca-4919-8d3a-2ed5e1580211 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.786047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882eb3-e5ca-4919-8d3a-2ed5e1580211 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.791564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 250/490] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:02.791564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882eb3-e5ca-4919-8d3a-2ed5e1580211 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:02.821620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb70a-c82a-4093-8e42-3fb8ffc6f57a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.860384 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.861051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.861331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.861615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.862419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:02.862820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:02.864801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53038c64-26a7-4914-924e-f60d8b6dd7c9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:02.880059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 241/491] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:02.882945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.882945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.883145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.900182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:02.901366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:02.919303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882eb3-e5ca-4919-8d3a-2ed5e1580211 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:02.958432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:02.959240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:02.959523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:02.959799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:02.966897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:02.968333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:02.969962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 242/492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:02.970746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-61d4c142-e6be-4489-a502-2021d17c2a59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:03.002226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.003506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:03.004743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:03.007983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 251/493] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.009222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78eb32-cf39-447a-be70-09101de4ffa0 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.009517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78eb32-cf39-447a-be70-09101de4ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.009796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78eb32-cf39-447a-be70-09101de4ffa0 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.011222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 252/494] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:03.012034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78eb32-cf39-447a-be70-09101de4ffa0 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.074481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ec42-cabe-4ad8-bc1f-9c287145bcd6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.111021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.111932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.112284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.112665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.113392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78eb32-cf39-447a-be70-09101de4ffa0 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.124974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.126861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:03.146386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.147485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.148538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:03.148538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:03.148538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:03.148538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:03.148538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 243/495] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.148941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.154849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89737579-d052-4428-9c48-44154ea90eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.155767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737579-d052-4428-9c48-44154ea90eac None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.156132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737579-d052-4428-9c48-44154ea90eac None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.156501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89737579-d052-4428-9c48-44154ea90eac None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.168546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89737579-d052-4428-9c48-44154ea90eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-89737579-d052-4428-9c48-44154ea90eac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:03.176342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.177380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:03.178371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:03.179635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 253/496] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.185288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.185643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.185985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.202833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:03.204110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:03.249655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ef2cc-e509-4a34-b8ed-ac95266a6dd4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.278482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 254/497] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:03.278482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.294937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.295612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.295898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.296177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.297025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:03.297340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.298789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.335474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 244/498] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:03.336227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.373977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0fce8-5f90-47d2-8f5c-682501ea99cd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.411145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.411793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.412072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.412342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.413053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:03.413467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.415304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee891b-c4e4-4f74-9d98-c06ca136f25f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.426542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 255/499] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:03.427952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74b06-3275-486e-b9b1-37a1520213e2 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.428241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74b06-3275-486e-b9b1-37a1520213e2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.428516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74b06-3275-486e-b9b1-37a1520213e2 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.430498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 256/500] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:03.431184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f74b06-3275-486e-b9b1-37a1520213e2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.438980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df194b1-69b9-4260-9c0f-d4dbf6a663e3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.471768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.472427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.472709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.473006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.473723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:03.474028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.475431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.483200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 245/501] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:03.483803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.533995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f74b06-3275-486e-b9b1-37a1520213e2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.565725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.566622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.566914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.567189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.576854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:03.579209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a587-f238-441c-a45c-79a26349d312 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:03.585050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.586134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 257/502] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.592149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.611237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.611883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.612162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.612436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.675437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.677432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.680532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004742-568a-4dc5-8051-ff6215289cbc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.713726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.715486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.715486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.715486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.722888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.724324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a119dd1e-f672-4123-ad96-65c0f3b17991 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:03.737851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.739237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:03.740119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 258/503] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.740866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.741146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.741416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.757755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:03.758954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:03.777807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 246/504] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:03.778672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.823424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 259/505] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:03.824518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.872180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86cc6a-0cbf-4e23-b7ac-c54e9a98268e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.903908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.904687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.904966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.905240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.915476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.916915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8c25-e0a5-4a19-96d1-dd5b3fdb60b1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:03.917019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:03.934137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:03.935018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:03.935863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:03.935863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:03.935863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:03.935863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:03.938760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 247/506] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:03.939422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:03.949549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:03.950206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:03.950515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:03.950794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:03.951543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:03.951849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:03.953217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:03.960886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 260/507] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:03.961656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.033725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fcf51-b3cd-4412-83cd-6b88c7013664 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.061975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8917-c1d9-4079-8a59-336012e5e1eb None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.066141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.066966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.067254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.067532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.068369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:04.068682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.070134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.086780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 248/508] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:04.087660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.093648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.094433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.094752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.095033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.106388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.107894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:04.125025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.126114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.126960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:04.126960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:04.126960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.126960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:04.126960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 261/509] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.127243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.183097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a72dd-6aee-43e6-a4a4-a0a1286f9264 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.215765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.216545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.216830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.217106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.222735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e071-ab9f-4391-ac9b-f05c84a6944c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.226811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.228265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:04.245562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.246389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.247270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:04.247270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:04.247270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.247270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:04.247270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 249/510] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.247534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.258201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.258889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.259179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.259455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.260179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:04.260484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.261861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.273370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 262/511] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:04.274004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.341120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510586-1dde-45ca-8bd5-5b2118d8ca0b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.365328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58a22-d79e-4dab-814f-77a7eb249c05 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.373125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.373902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.374184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.374472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.384893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.386274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.397140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.397767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.398046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.398317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:04.402995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.404084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 250/512] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.404937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.463468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.464921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.506857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155e3ee-f911-408a-9501-f3d83a7472e5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.541061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.541721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.542026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.542324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.543094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:04.543405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.544776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.556152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 251/513] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:04.556931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.564859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 263/514] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:04.565835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.654095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766f60-d259-4798-9516-7001e5c9e462 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.658678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ced2d-5a5d-44c8-850d-b298def4889d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.685373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.686022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.686295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.686616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.687335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:04.687644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.689011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.690386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.691186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.691973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.692251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.699050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.700495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.700901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 252/515] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:04.701690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:04.714919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.715997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 264/516] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.716907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.794929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8751f9-e280-4afa-8e4a-3b432c6b1ee4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.813827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7404a93-f3a5-440f-9e11-7151cc195e73 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.826720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.827370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.827652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.827926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.828639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:04.828944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.830310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.840978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 253/517] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:04.841756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.846178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.847001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.847285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.848139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.854770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.856212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:04.870729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.871691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:04.872709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:04.874604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 265/518] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.875555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:04.936198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46cf27-1f2f-41fe-a487-449d74f48b8c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.967484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:04.968261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:04.968539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:04.968813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:04.968975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36029980-088b-4c2a-b3f1-74d4f382dfd8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:04.978872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:04.980306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:04.997038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:04.998062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 254/519] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:04.999138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.003450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.004735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.005018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.005292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.005986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.007440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.026395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 266/520] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:43:04 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:05.027038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.103682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d6481-e10c-4465-8c05-1d247052494c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.135464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d540e-27a7-4270-af29-6e4a928cbe53 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.140919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.141660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.141947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.142275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.143164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:05.143481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.145072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.168597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 255/521] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 19:43:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:05.168597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.175103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.176428 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.176712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.176984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.185270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.186890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:05.201826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:05.203050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 267/522] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:05.204723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.275555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9779d-04d1-49ca-b153-a4de335defba None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.309685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.310341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.310653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.310933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.311399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dafeae-6335-4140-891a-df14833c8c5d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.311778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:05.312095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.313531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.331978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 256/523] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:05.333300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.349915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.350680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.350969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.351251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.351981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:05.352291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.353672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.370447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 268/524] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:05.370447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.438513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165548-c3df-4b5b-827a-fed2415e5023 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.469670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015460-8655-44f1-bb6f-bb83c6871874 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.474189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.475069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.475304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.475527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.505030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.506026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.506545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.507034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.508033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:05.508461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.510015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.549393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 269/525] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:05.550442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.556179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.557667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.652140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94be74d-5d55-4beb-9225-8fbad8a806d5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.661288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 257/526] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:05.661288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.687303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.687959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.688241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.688566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.689339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:05.689650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.691144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.696773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 270/527] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:05.697569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.787108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205a9e3-89db-4fb9-85ea-f26e5cd4909e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.823455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.823977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd538c-9c03-4fb6-be6a-c34bab94f3e5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.824325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.824610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.824936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.832996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.834559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:05.850168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:05.851111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 258/528] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:05.852563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:05.865458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.866193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.866388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.866705 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:05.937617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:05.939199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:05.956685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc93d03-a55f-4324-bf7f-5c839d8a0652 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:05.992544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:05.993612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:05.993901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:05.994179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.008291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.010099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:06.028381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:06.030448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 259/529] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:06.032583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.042887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 271/530] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:06.043927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.135405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053df04-9101-47d8-ae38-98a8bef62baf None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.143891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809832bf-ed8c-46ed-a93b-ea5c92051089 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.171082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.172018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.172305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.172749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.173859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.174317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.175962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.178378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.179174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.179555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.179929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.180754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.181233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.182755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.190177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 260/531] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.190999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.202422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 272/532] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.203537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.312256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d4112-bc08-49fe-b0f6-3f148e2bfb8b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.320689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc2ec3-b407-4c34-983f-9b2eda9e7b1c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.353567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.354826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.355115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.355528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.359807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.360578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.360956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.361329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.363152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=488a9120fefb464f9c9ff8faeb3f8668) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.363578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.365769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.365899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.367337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.373466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 273/533] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/role_assignments?user.id=488a9120fefb464f9c9ff8faeb3f8668&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.374275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:06.404463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:06.405561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:06.406620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:06.406620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:06.406620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:06.406620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:06.411098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 261/534] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:06.412024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.538435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a74983-ed17-4881-8a47-31934e10fe88 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.575075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.575909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.576195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.576479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.585123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.586645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:06.603889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:06.606017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:06.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 274/535] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:06.612837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.645983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35f973-ab75-49e2-95d3-dbe441004c00 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.683066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.683783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.684067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.684344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.685067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.685368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.686754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.702595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 262/536] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.703831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.717937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf27c-92c4-44b3-8ba4-bd737a5fa373 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.753141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.754345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.754760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.755039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.755833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.756141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.757582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.779544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 275/537] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.788422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:06.845583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1972737-324e-42d4-b0f0-2b71c60732f4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.895247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630dfba-c3e0-47eb-a753-1693bbc6515d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:06.920119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.921256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.921743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.922220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.934107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:06.934818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:06.935101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:06.935376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:06.936222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=072f8b74eaa248b3be4499823156491e) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:06.936534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.937943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:06.939494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.941110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:06.955555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 276/538] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/role_assignments?user.id=072f8b74eaa248b3be4499823156491e&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:06.969490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:06.970756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:06.972212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 263/539] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:06.977135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:07.086249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17811-71c3-4d08-8786-4f56e8953209 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:07.121983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:07.122682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.122967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.123277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.124084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:07.124457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:07.126242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935e38-688e-4ae3-9ca2-0898f938bf76 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:07.141258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 277/540] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:07.149291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:07.290315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9d06-3b45-4700-a303-297d3cd327d6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:07.340575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18760199-69d5-4490-ad67-e6291545feae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:07.341579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760199-69d5-4490-ad67-e6291545feae None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.342064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760199-69d5-4490-ad67-e6291545feae None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.342596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18760199-69d5-4490-ad67-e6291545feae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.343637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760199-69d5-4490-ad67-e6291545feae None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=34dcdccc1deb40478957efe9bf78dff9) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:07.344169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760199-69d5-4490-ad67-e6291545feae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:07.345819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18760199-69d5-4490-ad67-e6291545feae None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:07.354571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 264/541] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:07 2022] GET /identity/v3/role_assignments?user.id=34dcdccc1deb40478957efe9bf78dff9&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:07.448223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b3c6-3a3b-4f57-a852-b65df589e45f None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.448573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b3c6-3a3b-4f57-a852-b65df589e45f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.448796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b3c6-3a3b-4f57-a852-b65df589e45f None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.450396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 278/542] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:07.464573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.465203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.465684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.495661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:07.497302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:07.592056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 265/543] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:07.619886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58b3c6-3a3b-4f57-a852-b65df589e45f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:07.744123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58b3c6-3a3b-4f57-a852-b65df589e45f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:07.791195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:07.792004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.792298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.792578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.807406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:07.815382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:07.816979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:07.818404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 279/544] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:07.823210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:07.953544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb1dcc-3ac8-4164-9835-8450d7fa9064 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:07.993927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:07.994729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:07.994897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:07.995179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:07.995993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:07.996302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:07.997741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:08.007295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 266/545] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:08.012642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.138360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e76880-7c0e-461f-a8c3-79a3b222883d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:08.177698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:08.178501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.178791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.179064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.193031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:08.194537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-73f04944-e05b-4a07-8bb5-f85e3fbab8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:08.215807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:08.216638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:08.218380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:08.218380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:08.218380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:08.218380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:08.218380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 280/546] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:08.222590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.391936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9112dc-d343-48ce-8cda-fa8c38cce5b5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:08.440103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:08.440775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.441061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.441420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.442152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:08.442479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:08.443877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:08.448974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e00d5-4592-4742-8d09-d89e3876edc9 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.449283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e00d5-4592-4742-8d09-d89e3876edc9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.449529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e00d5-4592-4742-8d09-d89e3876edc9 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.451347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 281/547] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:08.456372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.456619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 267/548] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:08.456808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.456975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.463429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.507643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:08.508786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:08.564538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ec9b9-334d-4c3d-ae89-0f6ddcfce981 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:08.599428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:08.600218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.600501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.600777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.608331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:08.609780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:08.626214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:08.628494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:08.630682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 268/549] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:08.635257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.644025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 282/550] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:43:08.696357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.796668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11c6c6-fcc4-4098-a154-33ab2dc49cd7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:08.806445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60388e3c-53db-47ae-abc6-30af24ac2027 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:08.848917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:08.849722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.850007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.850284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.860911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:08.868812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:08.869691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:08.870967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 283/551] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:08.876387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.876917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:08.877602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:08.877884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:08.878161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:08.879088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:08.879400 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:08.880855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:08.915011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 269/552] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:08.920394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:08.978926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a6656-6fc8-4a50-a999-11dc95322b29 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.022038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.022835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.023032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.023314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.024065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:09.024378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.025773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.046337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 284/553] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:09.047396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.068002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ea7e8-cb26-4879-bb38-34f6f5789662 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.120353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.121027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.121310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.121584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.222248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918a2fe-f4d3-4439-a447-97d0bd4da97b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.236968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.238053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d323c1-be97-456b-a133-eaadcab1d794 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.284676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.285533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.285813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.286082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.300684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.302141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-701ce2ab-8954-4397-aa2f-24a398bab9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:09.329701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:09.330629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:09.331452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:09.331452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:09.331452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:09.331452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:09.331452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 285/554] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:09.332979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552ae5-a99c-48b0-8e46-fbeeab69d0cd None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.333263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552ae5-a99c-48b0-8e46-fbeeab69d0cd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.333534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e552ae5-a99c-48b0-8e46-fbeeab69d0cd None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.334810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 286/555] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:09.339837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e552ae5-a99c-48b0-8e46-fbeeab69d0cd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.387787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 270/556] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:09.389562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.389998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.390717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.411409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:09.412817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:09.457489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e552ae5-a99c-48b0-8e46-fbeeab69d0cd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.486654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 271/557] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:09.487741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.498391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.499382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.499863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.500351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.501548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:09.502060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.504236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.528204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 287/558] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:09.529367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.612634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f8a14-56db-43d7-a3cd-22213dd4135f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.632062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22549-dcab-415b-9c6c-9b64a68170a1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.652210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.653495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.653958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.654413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.670326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.672973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.676170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.677268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.677833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.678487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.692261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.694947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:09.703518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:09.704336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:09.705206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:09.705206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:09.705206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:09.705206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:09.705924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 272/559] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:09.707332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-8c23ea17-0476-4bd2-92a6-d1b77aa963b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:09.716420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:09.717364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:09.718248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:09.718788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 288/560] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:09.720105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ef41-f52f-4014-bcfb-0f795b5fc7bf None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.720392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ef41-f52f-4014-bcfb-0f795b5fc7bf None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.720668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036ef41-f52f-4014-bcfb-0f795b5fc7bf None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.721922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 289/561] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:09.725891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036ef41-f52f-4014-bcfb-0f795b5fc7bf None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.815352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221ad87-f58c-4dbf-9d14-a2269c0d9bec None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.824391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036ef41-f52f-4014-bcfb-0f795b5fc7bf None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:09.849318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.850110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.850384 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.850691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.857822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:09.858688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.858971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.859245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.859967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:09.860270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:09.860859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:09.861644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-343d57f2-9f29-47f6-be60-f028105ef054 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:09.868647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:09.869965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:09.871376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:09.878039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 290/562] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:09.878039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.878223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 273/563] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:09.878223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:09.878223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:09.878223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:09.893960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:09.895819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:09.966521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 274/564] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:09.966521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:09.978240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc84f2-54cd-422f-84b6-7eca1ca7c900 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.013387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.014059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.014340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.014641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.015547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.015864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.017313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.036080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 291/565] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.037141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.072912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10183ad0-6d7d-49d3-acc2-c28c7238fd4f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.109193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.109856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.110136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.110407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.111172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.111476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.112828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.122144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 275/566] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.122930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.151228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8a26-2b85-4b8f-b52d-4c45781eb20b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.185135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.185916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.186200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.186500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.192963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.194412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:10.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.209337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:10.210367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:10.214020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 292/567] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.214884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.223932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8376618-153d-4cba-88ea-74dce415669a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.255487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.256269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.256553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.256830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.266549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:10.274688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.275739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 276/568] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.281383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.308234 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228003-6d57-4a71-a392-c87f3eee9311 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.339526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.340305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.340591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.340863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.350933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.352368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-9b52648b-bedc-4973-b425-3a2a0d7d4264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:10.369114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.370105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.371174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:10.371174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:10.371174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.371174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:10.371174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 293/569] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.371912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06fb5-bbf8-42cf-903e-445baa7b0262 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.371912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06fb5-bbf8-42cf-903e-445baa7b0262 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.372135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa06fb5-bbf8-42cf-903e-445baa7b0262 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.373519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 294/570] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:10.374069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06fb5-bbf8-42cf-903e-445baa7b0262 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.380194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffcc87-5e23-4d16-9878-d3fb48f7d068 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.412960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.413743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.414026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.414304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.424562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.426034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:10.442750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.443792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 277/571] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.444864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.471425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa06fb5-bbf8-42cf-903e-445baa7b0262 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.504284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.504936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.505219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.505494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.506270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.506618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.508079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.526315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 295/572] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.526315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.543153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a828c3-8884-48ba-bfc7-8114d5144322 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.575547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.576208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.576493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.576772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.577514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.577824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.579222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163fadd-20a4-4428-95b4-958f9fdeaa39 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.587398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 278/573] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.588567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.588854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.589137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.605284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:10.606501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:10.618843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91eb63f-39cf-45dd-a2cd-cc1d62adb193 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.650629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.651220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.651504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.651778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.652491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.652798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.654162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.665533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 296/574] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.666333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.673816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 279/575] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:10.674746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.762147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabe5c5-3e48-49dd-9df1-0eed8a9fc5ed None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.767791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810210e-759a-494e-be9b-db65a34544b5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.793447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.794101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.794387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.794693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.795411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.795717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.797101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.800171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.800814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.801094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.801369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.802191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=983fe7993d594683afbc43f4a95885a1) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:10.802528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.803941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.808251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 297/576] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.809042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.809459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 280/577] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/role_assignments?user.id=983fe7993d594683afbc43f4a95885a1&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:10.810242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.912726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b48e8-53d2-4c64-aab3-6be21624bb64 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.914106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49b43-ba31-41d2-bf10-f70ac9b044d3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:10.948170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.948435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:10.948984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.949089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:10.949265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.949373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:10.949532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.949633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:10.957795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.959304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.961396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:10.963014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:10.974420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.975429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:10.976324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:10.978803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 281/578] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.979936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:10.981474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:10.982390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:10.983309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:10.983309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:10.983309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:10.983309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:10.983309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 298/579] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:10.984071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.083457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a9b0a-f9f2-4e93-abeb-28697562052d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.085209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bf53d-5915-4188-a0b7-0c4aa8f53b92 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.117933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.118380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.118761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.119039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.119222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.119318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.119499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.119771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] PATH_INFO: `/v3/users/glance` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.127160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.129232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.130155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:11.137730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:11.138917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:11.139741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 282/580] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:11.140784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:11.146596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:11.147597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 299/581] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:11.148557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.238929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8ca37-616c-4ad3-b604-8df58cfa5bdd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.244799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4b86-3353-40d7-a50c-34f1f08324ef None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.272664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.273323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.273603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.273876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.274925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:11.275226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.276644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.278152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.278737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.279031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.279313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.280039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:11.280349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.281714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.289809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 283/582] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:11.290944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.297880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 300/583] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:11.299444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.388403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9c46f-39d1-4703-8e04-42d56a1bb9fb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.402091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45905b0-4e2b-4a3b-ae44-03d237377dcd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.421366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.422059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.422344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.422647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.423393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:11.423702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.425066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.434573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 284/584] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:11.434573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.442694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.443368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.443653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.443931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.444767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:11.445075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.446640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.469056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 301/585] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:11.469056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.542497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112e674-e30d-4765-ba50-71d0565943b8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.564766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5035a-a3d7-4d98-b98e-0e5dbc10a55a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.575463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.576481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.576863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.577243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.592468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=fdcb012cc78d44a2afb7762daa15517c, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.594011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.599255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.600015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.600296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.600568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.607927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 285/586] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:11 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:11.608146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.609048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.609678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:11.635958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:11.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:11.638207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:11.645911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 302/587] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:11.647191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.732884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60b405-7a7f-4ff7-8947-4f5729625eba None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.772294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.773273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.773655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.774029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.774709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950662d-72a0-4ff8-a490-fee0eac33f9c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.785930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.787503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:11.808146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:11.809264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:11.810357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:11.810357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:11.810357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:11.810357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:11.812044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 286/588] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:11.812999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.820012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.821027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.821316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.821597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.834363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.835915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:11.853777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:11.854910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:11.856007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:11.856007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:11.856007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:11.856007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:11.861737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 303/589] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:11.862663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:11.915653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397e11-72f5-402e-abdd-5f5a1931d9a9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.951839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:11.952513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:11.952799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:11.953080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:11.953921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:11.954229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:11.955708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:11.966573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841927-527d-4549-8439-abd47b200ee0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:11.974608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 287/590] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:11.975552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.001925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.002643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.002934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.003217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.003981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:12.004293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.005675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.017935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 304/591] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:12.018815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.079469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145811e-127e-42a1-a3d2-fb20fd581565 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.113833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.114604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.114859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.118479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.118479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:12.118479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.118479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.126884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80f8f-836a-4a75-9edd-c88792ba26ef None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.129908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 288/592] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:12.130765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.167513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.168342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.168627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.168903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.180217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.181674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:12.198846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:12.200940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 305/593] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:12.203165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.234425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722dc4-1080-499c-a55f-1be839452201 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.268537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.269330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.269612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.269886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.277751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.279225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:12.294086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:12.296585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:12.298931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 289/594] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:12.301137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.309711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d77cf-a036-4220-9d5d-a07a698cade4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.343811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.344531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.344816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.345091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.352534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.354005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:12.372295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:12.374380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:12.376759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:12.382503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 306/595] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:12.382503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.402268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3b06-95c9-40e1-9f10-db1da3430159 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.437843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.438546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.438831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.439107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.439897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:12.440202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.441714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.454346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 290/596] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:12.455223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.488555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01994-124d-4873-a432-aa5c11414edf None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.537533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.538239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.538554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.538831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.539677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:12.539989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.541848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.565377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 307/597] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:12.566467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.579884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c088-2734-4e85-8366-8c4f069fea1b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.628639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.629293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.629521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.629799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.631103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:12.631422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.633323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.654093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 291/598] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:12.655140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.676955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b589fb-a154-4b9f-aab8-728f9fe642c8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.711431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.712388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.712771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.713148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.719993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.721637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:12.737443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:12.739505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:12.741495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 308/599] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:12.742389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.781665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898672b-e46a-44ad-a309-9bec4f4e907d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.814853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.815801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.816702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.817073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.828602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.830352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:12.849372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:12.851388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:12.853540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:12.853540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:12.853540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:12.853540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:12.862514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 292/600] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:12.862514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.866981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bdca9-0d7f-4a74-a5db-ba4e77267281 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:12.911412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:12.912747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:12.912747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:12.915774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/488a9120fefb464f9c9ff8faeb3f8668/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:12.931977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=488a9120fefb464f9c9ff8faeb3f8668, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:12.934423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:12.954540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 309/601] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:12 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/488a9120fefb464f9c9ff8faeb3f8668/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:12.955950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:12.993072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b14101-2b65-47e6-a351-8e28825ba590 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.063946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.064633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.065100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.065383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.066955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:13.067283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.069350 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d10ce-1bcc-4b3b-91cd-307f6c1f221b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.086226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 293/602] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:13.087715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac250-a12e-4996-ac41-d4428e16be28 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.088003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac250-a12e-4996-ac41-d4428e16be28 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.088276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac250-a12e-4996-ac41-d4428e16be28 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.094451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 294/603] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:13.095878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.096562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.096844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.119038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:13.120783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:13.123651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5c2e-1268-4fb1-a9ed-837d8e1db0ce None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.168441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.169065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.169425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.169796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.170645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:13.171108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.172542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.187533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 310/604] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:13.188439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.203815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 295/605] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:13.204734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.301558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ada8-ba5d-44e5-928c-d2f692d8019b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.314338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab75e1-becd-44a2-bb7c-0fe9e2dcaf00 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.345411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.346661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.347166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.347570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/072f8b74eaa248b3be4499823156491e/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.348665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.349607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.350033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.350536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.358037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.359766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.364482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=072f8b74eaa248b3be4499823156491e, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.365935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:13.376903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:13.377810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:13.378800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:13.385220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 311/607] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:13 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/072f8b74eaa248b3be4499823156491e/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:13.385220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.385519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 296/607] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:13.386591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.564039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb68b2-ca18-4ab5-97a5-42741a12e286 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.591407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be047fa3-3a02-4e14-a62f-92baa5d21ee0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.602167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.602887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.603175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.603457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.604251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:13.604564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.606002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.619218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 297/608] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:13.624812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.631447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.632247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.632530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.632806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.643373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:13.652690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:13.653652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:13.654517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:13.658782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 312/609] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:13.659662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:13.784693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aaefe-7666-4b80-b257-1c2634de6aba None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.847457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.848292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.848577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.848853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/34dcdccc1deb40478957efe9bf78dff9/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.855247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bfb9a-8021-471a-abc8-2f8c06f0622e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:13.868771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=34dcdccc1deb40478957efe9bf78dff9, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.870283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.888624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 298/610] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:13 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/34dcdccc1deb40478957efe9bf78dff9/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:43:13.921034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:13.921820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:13.922161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:13.922444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:13.923385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:13.923700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:13.925135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ddc47-dcf7-41be-945e-b8a05ae90330 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:13.940287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 313/611] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:13.946861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.086888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9008-02e6-4cd3-aa6f-ca0a900d3ab3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.139149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.139149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.139149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.139149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.155420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:14.157214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:14.176782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae4f6-28de-41bc-9021-0f3e6a8aade9 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.177322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae4f6-28de-41bc-9021-0f3e6a8aade9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.177398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ae4f6-28de-41bc-9021-0f3e6a8aade9 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.178793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 314/612] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-0d3aa2aa-10d9-46a3-bcd2-42a98bcfc15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:14.179629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:14.180520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:14.181561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:14.181561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:14.181561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:14.181561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:14.181561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 299/613] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:14.186881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ae4f6-28de-41bc-9021-0f3e6a8aade9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.187407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.187791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.188078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.217250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:14.218451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:14.307715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ae4f6-28de-41bc-9021-0f3e6a8aade9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.311543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 300/614] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:43:14.343161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.352415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.353091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.353378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.353656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.354387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:14.354723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:14.356127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:14.382221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 315/615] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:14.387545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.506862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab222eb9-ba36-4faa-8a8e-1368aa8ed24b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.550694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71ca9b-f3a9-4e49-a27e-9f88d70b14df None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.579393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.580250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.580532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.580807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.596594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:14.605254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:14.606174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:14.607040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 301/616] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:14.611988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.612405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.613440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.613949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.614418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.631537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:14.633303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:14.662640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:14.663653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:14.664600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:14.666473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 316/617] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:14.669155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.782075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0b91-2b4b-4ee6-881f-6e960c35fc4f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.814356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867f1ce-bfa6-4f1e-affb-9479805a9fcd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:14.817960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.818663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.818953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.819231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.819991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:14.820301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:14.821673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:14.830381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 302/618] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:14.835781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.891085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:14.891767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:14.892051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:14.892329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:14.893175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:14.893488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:14.896910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:14.924966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 317/619] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:14.933126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:14.975579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3fe5a-50a9-4e85-b3fd-f9ac24ff951a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.014488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.014488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.014488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.014488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.022674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.024117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:15.043115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:15.044029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:15.044902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:15.044902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:15.044902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:15.044902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:15.044902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 303/620] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:15.055528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.096067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fa507-f436-4993-bb57-3b8cc8f9e474 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.137083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be629777-7676-416c-8688-565bc90fd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.138134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629777-7676-416c-8688-565bc90fd932 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.138589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629777-7676-416c-8688-565bc90fd932 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.139002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629777-7676-416c-8688-565bc90fd932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.154177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be629777-7676-416c-8688-565bc90fd932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.156571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be629777-7676-416c-8688-565bc90fd932 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-be629777-7676-416c-8688-565bc90fd932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:15.184066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:15.185416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:15.186287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:15.186287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:15.186287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:15.186287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:15.198602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 318/621] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:15.204750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be629777-7676-416c-8688-565bc90fd932 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.229844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb17c54-7a28-4e8b-ab1c-37208ccbcf93 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.292320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.293370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.293825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.294278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.295191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:15.295683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.297196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.318497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 304/622] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:15.324480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.398707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be629777-7676-416c-8688-565bc90fd932 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.463299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.464304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.464781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.465243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.466188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:15.466912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.468493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.490814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 319/623] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:15.497504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.499708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e678e-f968-46ae-88f3-b35099533941 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.570504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.572027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.572499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.573271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.582510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.583986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-e863779e-c2e5-4279-830a-feeb4669ae2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:15.601523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:15.602533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:15.603484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:15.606124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 305/624] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:15.611934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe2ec-a8e5-4871-8aac-34cca06cb4ab None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.612441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe2ec-a8e5-4871-8aac-34cca06cb4ab None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.613543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe2ec-a8e5-4871-8aac-34cca06cb4ab None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.615321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 306/625] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:15.616203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe2ec-a8e5-4871-8aac-34cca06cb4ab None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.644583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfac63-36fc-4c6a-8616-c81d62cc438f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.678553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.679677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.680183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.680647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.687871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.689592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-d50bb9ba-b762-4330-b1b2-28b1a5f33109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:15.705025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:15.705932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:15.707409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:15.709497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 320/626] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:15.711050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.711572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.712052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.730337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:15.731895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:15.740958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe2ec-a8e5-4871-8aac-34cca06cb4ab None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.784261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.785480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.785772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.786049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.786936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:15.787247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.789321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.801789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 321/627] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:15.803014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.819976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 307/628] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:15.830339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:15.928339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c540eca-ad2e-4af0-a21d-ec5841fc1685 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.941320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22c13-1418-40ee-94d1-4b02c1767237 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:15.972545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.973347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.973712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.973998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.974982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:15.975306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:15.977123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:15.977612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:15.978718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:15.979214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:15.979693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:15.991565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:15.991888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 322/629] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:15.992747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:16.000260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:16.001425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:16.002401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:16.005242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 308/630] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:16.006238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.100545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa21f2-0897-43ae-8b0b-4f95fa5e378d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.111055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51da6-2fce-403a-9c61-ce0ee3c13834 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.134897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.135842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.136302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.136768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.145881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.146809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.147095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.147372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/983fe7993d594683afbc43f4a95885a1/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.162552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=983fe7993d594683afbc43f4a95885a1, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.163996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.176937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 309/631] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:16 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/983fe7993d594683afbc43f4a95885a1/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:16.179356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.223322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.226558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc4d34-53ca-4957-bcf3-f468d339f6a3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.316587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98794ce-a061-440e-a491-c150f6b7b515 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.358397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 323/632] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:16.360720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c929-01f4-4cf6-99bb-dafa524cdf92 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.361016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c929-01f4-4cf6-99bb-dafa524cdf92 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.361368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c929-01f4-4cf6-99bb-dafa524cdf92 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.362276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.366502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 324/633] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:16.366502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c929-01f4-4cf6-99bb-dafa524cdf92 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.367452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.368014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.368587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.369566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:16.369876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.371322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348a72-0911-499f-8891-830dde4ffbae None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.382045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 310/634] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:16.383823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.384311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.384740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.406266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:16.407485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:16.486568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 311/635] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:16.487488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.491487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c929-01f4-4cf6-99bb-dafa524cdf92 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.534483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.534483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.534483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.534483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.548709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.551409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:16.576777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:16.577716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:16.578636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:16.578636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:16.578636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:16.578636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:16.578636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 325/636] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:16.583927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.607345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d9ca-b1f2-4528-afb3-90dceffc4384 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.640583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.641295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.641576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.641848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.652088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.653534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c0737f35-8351-4cd7-bc1d-79650793173c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:16.671052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:16.671969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:16.672860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:16.672860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:16.672860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:16.672860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:16.672860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 312/637] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:16.673563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b41c4-9ac7-4f24-8297-71dc45fcf123 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.673720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b41c4-9ac7-4f24-8297-71dc45fcf123 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.673967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b41c4-9ac7-4f24-8297-71dc45fcf123 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.678496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 313/638] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:16.678496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b41c4-9ac7-4f24-8297-71dc45fcf123 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.689942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a365e-27f1-45ec-a442-df891439e959 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.724797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.725593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.725875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.726151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.735997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:16.743693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:16.744642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:16.745491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 326/639] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:16.746200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.784495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b41c4-9ac7-4f24-8297-71dc45fcf123 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.819500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.820162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.820440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.820713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.821425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:16.821814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.823238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302e635-530f-4e61-adf2-5b6d52bcc7c9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.839866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 314/640] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:16.839866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.839866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.839866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.853719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf9465-e171-4820-b712-1593d17028c1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:16.855850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:16.857010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:16.887161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:16.887821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:16.888102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:16.888373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:16.889087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:16.889392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:16.890833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:16.902824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 327/641] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:16.903626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:16.938552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 315/642] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:16.938552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.001430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6420-ce5b-40cc-9288-397f6567f8dc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.037763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.038819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.039330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.039611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.040421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.040759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.042123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabbfe9-e223-4ab7-a7bf-9044aa635c2d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.042307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.054897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 328/643] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.054897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.078868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.079660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.079939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.080212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.087388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.088830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:17.104200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:17.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 316/644] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:17.111266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.161284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfd88a-a6b0-482e-ba31-4e0bd587d11a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.192974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.193790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.194074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.194346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.201645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.203123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.209140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e668-ab44-4c40-bbf1-aa3d9acc18ec None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:17.217415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:17.218447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:17.219538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 329/645] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:17.220180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.244840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.245631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.245925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.246204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.256556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:17.264176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:17.265121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:17.265971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 317/646] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:17.266709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.325001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e13e-172e-4866-bfef-598f32550fb9 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.358156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.358993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.359278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.359561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.368526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbda0d-9c97-47fc-aee6-fcceb683dd1b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.371218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.372737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:17.390882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:17.391828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:17.392762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:17.392762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:17.392762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:17.392762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:17.392762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 330/647] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:17.393033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.408188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.408857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.409146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.409425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.410786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.411102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.412589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.424436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 318/648] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.425287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.501204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff860c70-3411-4494-9c73-7299df3490ad None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.534180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b548-fcc0-47b5-afc3-14c7dd2349c4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.542290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.543207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.543589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.543968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.544905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.545311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.546853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.570722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 331/649] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.570722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.576432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.577207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.577592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.577967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.578941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.579362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.580805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.594120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 319/650] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.594120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.666534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26f4d-7ff0-46e7-be0e-24054791d2f0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.692372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2166a-1218-4c1e-b1aa-eec7102c98fd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.699788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.700652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.700935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.701206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.701927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.702231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.703636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.715553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 332/651] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.716645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.728368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.729136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.729505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.729829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.730762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:17.731158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.732894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.739196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 320/652] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:17.751742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:17.825267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7a38-f0ca-4013-baf3-4f9059432ce2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.861333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.862254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.863276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.863718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.874448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49e46-042a-49ca-9866-aa19050482f6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:17.912520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:17.913535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:17.914045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:17.914843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:17.926951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.928522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.938054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:17.939563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:17.952567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:17.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:17.954768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:17.954768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:17.954768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:17.954768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:17.956847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 321/653] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:17.957840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.042994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 333/654] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:18.043946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.067043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbd5f1-b3cb-4a69-9892-b314dd5dbcfc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.108902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.109847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.110236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.110754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.118839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.120413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:18.135595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:18.136767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 19:43:18.137760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:18.138507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 322/655] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:18.139210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.163127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83002573-babf-4e60-8c7c-42478dad565d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.198755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.199865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.200323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.201050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.202215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:18.202862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.205008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.219737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 334/656] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:18.221175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.250152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5521f-dab8-479b-a644-d14a59392527 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.290328 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.291163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.291443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.291720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.303032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.304339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:18.322265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:18.323397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:18.324317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:18.324317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:18.324317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:18.324317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:18.328258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 323/657] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:18.329365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.352559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060edbc-9f25-47fa-a632-0943f7f41008 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.397442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.398541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.398969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.399856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.401216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:18.401671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.404165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.426719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 335/658] 10.222.0.57 () {56 vars in 1139 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:18.428296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.433822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2950-0d81-4ea3-b8a5-464a09107098 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.468806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.469525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.469803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.470080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.478151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.479743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:18.494824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:18.495991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:18.497097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:18.500835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 324/659] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:18.501664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.551097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009e85-3dc9-4a4f-af90-3326f6d4674f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.590389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.591370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.592218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.592700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.593562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:18.594011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.595543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.603038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57107b0-4ef0-46b1-869b-1fb390fc2166 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.607209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 336/660] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:18.608026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.638311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.639254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.639532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.639807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.709666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.711440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.711920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c524-88fb-4b4b-a5bc-98498efbebf7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.744165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.745141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.745661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.746007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.746861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:18.747171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.748586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc679125-8d12-4aec-bda9-bcc653dca639 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.766242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 337/661] 10.222.0.57 () {56 vars in 1137 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:18.767881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687812e-1bcd-4d06-abe9-cf5e311e1730 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.768244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687812e-1bcd-4d06-abe9-cf5e311e1730 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.768592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687812e-1bcd-4d06-abe9-cf5e311e1730 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.770794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 338/662] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:18.773101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687812e-1bcd-4d06-abe9-cf5e311e1730 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.820163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 325/663] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:18.821424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:18.879635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687812e-1bcd-4d06-abe9-cf5e311e1730 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.914974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.916067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.916342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.916618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.922893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7040ff9-9861-4d14-9156-5c2cffe22dd4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:18.923118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:18.924555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-508daf1d-abd2-4a87-b2ae-0b179899df50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:18.937786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:18.938708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:18.939594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 339/664] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:18.940519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.940519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.941258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:18.958589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:18.959873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:18.961502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:18.962142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:18.963103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:18.963103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.026771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 340/665] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:19.027893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.038491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.040297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.133787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda08b23-380e-4fe4-b370-c652731d26e1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.143067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 326/666] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:19.143067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.172439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.173239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.173527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.173799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.184322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.185774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:19.203282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:19.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:19.205124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:19.205124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:19.205124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:19.205124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:19.205124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 341/667] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:19.205398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.244424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caacff-ad5a-4d53-bf97-a38a1e039fbd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.278050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.279046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.279435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.279721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.280503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:19.280818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.282237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.298215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 327/668] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:19.298215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.308389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff267e-8915-4840-90dd-62df879fc964 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.342194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.343017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.343304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.343586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.353316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:19.360944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:19.361886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:19.363281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 342/669] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:19.363982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.400660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09318565-b903-40ea-9bce-8e6086c93b63 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.434069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.434905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.435188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.435474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.447233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.448677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.459845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9adc-a295-4bd4-8a41-cc740ced2603 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:19.466006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:19.467134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:19.468030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:19.468030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:19.468030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:19.468030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:19.468030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 328/670] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:19.469933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.497493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.498160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.498632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.499211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.500219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:19.500791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.502824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.514894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 343/671] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:19.515944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.585057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306a7c0-8fdc-4cea-a8df-fe8c547bd2b8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.617905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.618596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.618885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.618987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db60a6-44f1-4f46-becc-d4ef3a293f3f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.619160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.620000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=488a9120fefb464f9c9ff8faeb3f8668) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:19.620320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.621755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.638733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 329/672] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/role_assignments?user.id=488a9120fefb464f9c9ff8faeb3f8668&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:19.638733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.677757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.678633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.679014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.679730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.680944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:19.681357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.683086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.698683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 344/673] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:19.699675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.762443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad1cbd-7175-46a4-9c48-0cd2be7946df None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.805754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.806429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.806770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.807037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.807768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:19.808073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.809457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.812820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05acef-ff54-4d4f-a868-4401f057938d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.827902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 330/674] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:19.828848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.848660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.849438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.849729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.850007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.856919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.858385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:19.872520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:19.873424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:19.874316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 345/675] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:19.874835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:19.937250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffea421-53c5-44bb-b186-16c485a1b88f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.976627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:19.977775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:19.978285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:19.978815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:19.982728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acddd-c641-45b9-a2e0-4e006debdd91 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:19.990505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:19.992244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:20.011020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:20.011939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:20.012832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:20.012832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:20.012832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:20.012832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:20.015112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 331/676] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:20.016175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.023198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.024000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.024278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.024547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.031709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.033155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:20.047898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:20.048928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:20.049825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 346/677] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:20.051592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.125073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ae477-b38d-465f-81df-210ea7fccadf None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.152059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd8526-cd04-4bf6-85c1-34707a500e28 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.159943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.160604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.160892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.161173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.161959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.162268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.163721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.175861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 332/678] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.177381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.199806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.200775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.201259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.201726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.202649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.203126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.204656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1cf2e-848c-4e5c-88f2-ea72b84de653 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.221334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 347/679] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.221334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165fa6-dd25-4226-b9c3-cd4d2db0be57 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.221334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165fa6-dd25-4226-b9c3-cd4d2db0be57 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.221334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165fa6-dd25-4226-b9c3-cd4d2db0be57 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.222188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 348/680] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:20.223022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165fa6-dd25-4226-b9c3-cd4d2db0be57 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.283190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367862b-77cc-4b63-9fd0-04648b00d89b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.319076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.319790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.320079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.320359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.321143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.321358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165fa6-dd25-4226-b9c3-cd4d2db0be57 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.321465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.322928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.340093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 333/681] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.340093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.360175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.360840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.361494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.361494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.362212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=072f8b74eaa248b3be4499823156491e) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.362625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.364546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207a5d-00f1-4f6c-a3d9-ed1e6b2d5a15 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.370752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 349/682] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/role_assignments?user.id=072f8b74eaa248b3be4499823156491e&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.372185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.372478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.372753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.391674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:20.392822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:20.462743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c777fb9-a3ef-4303-93f2-b66996dac7c3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.486212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 350/683] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:20.489601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.517389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.518206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.518591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.519104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.530021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.531843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:20.549694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:20.551440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:20.552518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 334/684] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:20.557965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.626923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7805e-4cec-41ea-81a0-eb200c5b6a52 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.673351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.674711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.675703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.676381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.677382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=34dcdccc1deb40478957efe9bf78dff9) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.677865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.678145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd8c97-55d7-4813-9e7a-29e8d7b2b6a3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.679864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.687969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 351/685] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/role_assignments?user.id=34dcdccc1deb40478957efe9bf78dff9&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.689066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.715221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.716102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.716462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.716815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.728857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:20.736809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:20.738346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:20.744623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 335/686] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:20.747063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.804586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6458-9af7-4bd4-af4f-ac5b4693fe8c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.841439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.842604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.843119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.843590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.844632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.845159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.846851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.854020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abb6d-06b1-4027-b820-fac47587cf78 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:20.870627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 352/687] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.873256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:20.899041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:20.902102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:20.902490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:20.902787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:20.903617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:20.903930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:20.908230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:20.928788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 336/688] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:20.934787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.033320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e20ea6-8966-4435-bfd4-e788707d3d43 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.064207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab855d-2718-4ec9-a57e-32e922a20918 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.078201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.078985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.079436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.079720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.103763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.104565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.104855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.105136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.117716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.119341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:21.146862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:21.147797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:21.148692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:21.148692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:21.148692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:21.148692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:21.150530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 337/689] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:21.155276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.161454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.163863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.300056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820056bb-0327-4595-9dd7-76aa67969132 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.341796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.342489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.342777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.343057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.343782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:21.344089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.345457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.356001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 353/690] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 19:43:21.361711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.369995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 338/691] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:21.383812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.468017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c343-6c4a-4235-8a14-f47945782bee None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.502419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.503342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.503632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.503910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.522037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.524122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:21.552501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:21.553445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:21.554334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:21.554334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:21.554334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:21.554334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:21.554334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 354/692] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:21.559461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.584781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0bee-434d-4f23-a3a1-d147cc45017f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.647951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.649164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.649653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.650130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.662008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.663789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.688837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f192d7-e5d9-4f76-bd09-76634131d437 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:21.698386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:21.699399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:21.700342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 339/693] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:21.705069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.730084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.730784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.731069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.731350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.732075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:21.732385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.733781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.754647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 355/694] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:21.763538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:21.886017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b33bb-befd-456d-a852-62e47e30bfc2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.923783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:21.925299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:21.925791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:21.926270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:21.932439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c612f-8d20-4abe-ad54-20a9611d62fc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:21.934268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:21.936835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:21.953314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:21.954226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:21.955221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:21.958267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 356/695] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:21.964104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.003568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.004524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.004956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.006526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.007541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:22.009432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.011147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.053076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 340/696] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:22.058508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.126323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff6e9d-ad6e-4313-a273-51c5ef7852dd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.163613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.165136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.165634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.166115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.167141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:22.167656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.169312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.183202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 357/697] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:22.190705 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.285460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faca1d-bb81-49b2-ac1b-0c9935937b40 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.320942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.321600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.321783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12957d4-ffaf-4f2b-9a6b-7e8bafc75a94 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.321885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.322150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.364195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.365163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.365456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.365792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.366888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=983fe7993d594683afbc43f4a95885a1) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:22.367214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.369470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa8cf-e825-4ab2-9595-5a019a0611fd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.377954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 358/698] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/role_assignments?user.id=983fe7993d594683afbc43f4a95885a1&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:22.379903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212064-ae34-4134-9c43-6ff9fe88a117 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.380197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212064-ae34-4134-9c43-6ff9fe88a117 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.380477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a212064-ae34-4134-9c43-6ff9fe88a117 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.382083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 359/699] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:22.396860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.397151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.397437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.404815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.411886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.428852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:22.430247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:22.522864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 360/700] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:43:22.570629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.629738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 341/701] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:22.638836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.712314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355d9bf-8760-4f63-9f2a-6a04975388b7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.750056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.751124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.751412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.751689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.763304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.764779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.776805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff447-bd7f-4c55-bc33-dbf280babff5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:22.783918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:22.785432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:22.786513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:22.786513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:22.786513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:22.786513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:22.786513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 361/702] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:22.791381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.838123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.839716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.840108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.840496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.854602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.856690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:22.879920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:22.880879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:22.881922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:22.881922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:22.881922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:22.881922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:22.882172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 342/703] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:22.887530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.907329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d80fc-4db5-4bc7-a18f-3b63078781b1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:22.942810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:22.943478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:22.943763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:22.944035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:22.944759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:22.945066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:22.946439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:22.959156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 362/704] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:22.964691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:22.993261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cfdec-f5ca-4fb2-893a-b6597b5f68a5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.033536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.035360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.035844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.036325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.037242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:23.037754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.039559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb5089-0d82-4070-a612-426fc93b5329 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.056902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 343/705] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:23.058599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf333-f3bb-488d-936b-5956b30c0d49 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.059104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf333-f3bb-488d-936b-5956b30c0d49 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.059575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf333-f3bb-488d-936b-5956b30c0d49 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.065255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 344/706] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:23.066997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf333-f3bb-488d-936b-5956b30c0d49 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.067549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032768a-5cc1-452e-8854-73e738800977 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.101796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.102500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.102785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.103061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.103766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.105213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202630bd-4d3f-4893-8993-35b6e3f186ac None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.129240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 363/707] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:43:22 2022] POST /identity/v3/users => generated 254 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:43:23.131366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.131866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.132410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.161745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:23.166224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:23.225256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf333-f3bb-488d-936b-5956b30c0d49 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.265370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.266969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.267601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.268180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.277716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.279598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:23.297720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:23.298708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:23.299577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:23.307116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 345/708] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:23.309745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.338852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 364/709] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:23.361682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.444210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f3c5-d129-4f5d-af2a-ee09d7c478cd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.485343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2b187-913b-4336-8446-391b06b50bfa None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.488984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.489882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.490378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.490888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.491862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:23.492372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.493991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.510574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 346/710] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:23.513115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.527439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.528219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.528646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.528934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] PATH_INFO: `/v3/services/network` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.529608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.531762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-92e205d0-9ca8-4cd5-8965-ace9d878ca88 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:23.550185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:23.551292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:23.552561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 365/711] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:23.553354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130b34-8553-470a-8564-1f6a7a58203f None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.553354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130b34-8553-470a-8564-1f6a7a58203f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.553750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130b34-8553-470a-8564-1f6a7a58203f None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.555078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 366/712] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:23.560173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130b34-8553-470a-8564-1f6a7a58203f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.636845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab22eef-358f-4750-93d0-60437309862f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.672764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.673356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.673646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.673925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.674798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:23.675146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.676633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51e42-bd1f-4505-9bdb-b5c178b70feb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.686494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 347/713] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:23.686494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.686494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.686494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.711599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:23.712598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130b34-8553-470a-8564-1f6a7a58203f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.713407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:23.775518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.776498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.777613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.778121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.779084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] RBAC: Adding query filter params (name=network) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:23.779572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.781183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.788425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 367/714] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:23.793867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.853314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 348/715] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:23.887537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:23.908681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71393b-b1d5-47ef-a526-af8d8dfe7b65 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:23.949053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:23.950046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:23.950535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:23.950992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:23.951879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] RBAC: Adding query filter params (type=network) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:23.952367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:23.953924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:23.960004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 368/716] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:24.050719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d5b78-27f2-4da0-a322-4738369bd199 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:24.096439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:24.098099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:24.098614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:24.099065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:24.099906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:24.101476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:24.121763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:24.127059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:24.128690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:24.131396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 349/717] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 19:43:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:24.136971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:24.262446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fea7a-b0d9-4816-8a18-0b99a6c05f63 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:24.300285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:24.301259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:24.301690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:24.302110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:24.303010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:24.303460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:24.305075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa646f9f-fd99-4390-ae90-d68b24d6cbc5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:24.310284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 369/718] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:24.316964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:24.418647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfeb6-bfd7-427f-88a1-cd7c03206806 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:24.452442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:24.453316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:24.453743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:24.454158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:24.455065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:24.455531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:24.457655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347e5f-35b3-40e9-8559-96d8be50670b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:24.463720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 350/719] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:25.460354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4134-70ca-4556-95be-dd96712913a0 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.460878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4134-70ca-4556-95be-dd96712913a0 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.460956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef4134-70ca-4556-95be-dd96712913a0 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.462516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 370/720] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:25.468050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.468463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.468636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.485898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:25.487115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:25.584135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 351/721] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 19:43:25.608388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef4134-70ca-4556-95be-dd96712913a0 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:25.714754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef4134-70ca-4556-95be-dd96712913a0 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:25.749661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:25.750748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.751019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.751288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.762186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e99fd16c-ff2e-4093-85fe-44d7e25fe632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:25.769814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:25.772070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:25.774092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 371/722] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:25.777095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:25.879586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329d2a5-20c4-437f-a3c1-42ebf23f5cc5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:25.886143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5357-8a55-46af-ae3b-88e6ee71793f None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.886430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5357-8a55-46af-ae3b-88e6ee71793f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.886728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5357-8a55-46af-ae3b-88e6ee71793f None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.888344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 372/723] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:25.895836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.896141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.896430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.915221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:25.917202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:25.940306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:25.941011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:25.941296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:25.941575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:25.942357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:25.942649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:25.944035 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:25.960933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 352/724] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:25.967934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:25.997049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 373/725] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:26.026229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.142256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250103c-6b39-418e-b527-62fbaf11bf04 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.156524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3ea6f-90d8-4365-842d-8ca7c1d2956a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.210884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.212235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.213170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.213990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.223884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.224630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.224917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.225198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.227678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:26.235676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:26.236595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:26.238307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:26.241904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 374/726] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:26.247372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.248965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.249762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:26.286961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:26.287907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:26.288799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:26.288799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:26.288799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:26.288799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:26.292431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 353/727] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:26.299552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.361480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a7cc2-94c9-4dbb-bbbe-cb942e1b86dc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.407688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.408732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.409748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.410221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.411282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:26.411788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.413578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.429046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 375/728] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:26.439703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.509639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563693e4-a21f-45e2-bd4e-60e1453c470a None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.551903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.552213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.552433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.552709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.553422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:26.553729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.555124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab306-cf07-4245-a963-bfe1a1cfb657 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.567930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 354/729] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:26.569296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32263c-b1ba-4890-8fcb-44b96b826e51 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32263c-b1ba-4890-8fcb-44b96b826e51 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.569858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32263c-b1ba-4890-8fcb-44b96b826e51 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.575730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 355/730] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:26.575730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32263c-b1ba-4890-8fcb-44b96b826e51 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.588766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6ccd2-cb2a-46cc-aab3-9c91236520d4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.624483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.625935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.626424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.626990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.638874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.640650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-35136bdd-e7da-45ef-b191-5a51c550be2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:26.658199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:26.659384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:26.660352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:26.660352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:26.660352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:26.660352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:26.662523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 376/731] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:26.663992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.664487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.665011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.682423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32263c-b1ba-4890-8fcb-44b96b826e51 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.683318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:26.684848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:26.720069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.720884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.721167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.721441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.735879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.738140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:26.757735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:26.758833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:26.759844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 356/732] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:26.760448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.770623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 377/733] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:26.771891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.861112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e8b33-556b-478b-968c-044690ccbf27 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.889241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a2fb7-655a-48f2-86ea-c135c80d56c3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:26.897108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.897773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.898054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.898332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.899089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:26.899387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.900749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.918698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 357/734] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:26.918698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:26.928476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:26.929592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.930024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.930303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.931204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:26.931515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:26.932943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847b66a-923c-4f87-992f-18985e8b1c7e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:26.949753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 378/735] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:26.951049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b2fa-2991-4678-a5f9-3ae262849dab None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:26.951337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b2fa-2991-4678-a5f9-3ae262849dab None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:26.951614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b2fa-2991-4678-a5f9-3ae262849dab None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:26.957837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 379/736] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:26.957837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09b2fa-2991-4678-a5f9-3ae262849dab None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.023377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94b428-9394-4319-a40e-1916aeeb1df2 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.057367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.058191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.058425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.058812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.061675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09b2fa-2991-4678-a5f9-3ae262849dab None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.068931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:27.076515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:27.077478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:27.078315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 358/737] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:27.079597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.101060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.101870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.102158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.102436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.109417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.110904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-c6a2cbd9-a209-468d-9a96-3fa8941be0b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:27.126594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:27.127720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:27.128876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:27.130804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 380/738] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:27.132163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.132598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.132874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.151054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:27.152238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:27.183584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621206-f54b-4000-8b32-ef57f12f5477 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.218344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.219015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.219290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.219559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.226643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 381/739] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:27.226643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.292970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.294339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.324652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546abab-669c-4e99-9005-229aa33907d1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.357534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.358221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.358516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.358806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.359550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:27.359856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.361237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.373723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 382/740] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:27.373723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.390442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 359/741] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:27.391276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.464517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44578-8e37-47aa-ad04-239430c3407f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.482119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0714-fd9d-474e-8091-8d927121cdc7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.496304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.496969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.497250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.497526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.498354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:27.498698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.500130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344a61a-b228-466f-a020-25cb5ba359c7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.514734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.515382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.515662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.515936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.516642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.521944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 383/742] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:27.522108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.522299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac731d-2740-484c-aaef-3ce12db73183 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.522299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac731d-2740-484c-aaef-3ce12db73183 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.522299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac731d-2740-484c-aaef-3ce12db73183 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.522299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 384/743] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:27.522299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac731d-2740-484c-aaef-3ce12db73183 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.537720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 360/744] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:27 2022] POST /identity/v3/services => generated 240 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:27.538565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.639116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac731d-2740-484c-aaef-3ce12db73183 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.646060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b91d-ddbf-4619-9c7a-425b14fe3382 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.676933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.677750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.678036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.678318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.683581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.684753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.685219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.686121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.689320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.691415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.700851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.702983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:27.710060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:27.711091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:27.711990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:27.711990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:27.711990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:27.711990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:27.715999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 385/745] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:27.716889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-23454862-e174-400c-a516-d4d13d3dd4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:27.723865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:27.724746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:27.725658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:27.725658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:27.725658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:27.725658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:27.725658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 361/746] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:27.726287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.727335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.727335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.745361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:27.746588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:27.821027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0cb71-10e5-4960-978f-8a02548272a1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.826621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 362/747] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 19:43:27.827732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:27.857451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.858100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.858386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.858698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.925571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.927025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.931034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed670e-50c7-4e20-bb94-6b6c9bcf2ac2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:27.964141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:27.964808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:27.965090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:27.965364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:27.966089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:27.966396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:27.967787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:27.981318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 363/748] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:27.982273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.029045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 386/749] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 19:43:28.030264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.085466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1600b8-e92c-4422-b3c6-13cc901da0b7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.119823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.120733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.121016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.121293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.122007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:28.122311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.123688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.129763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc929-f754-4d38-8654-db0f4b249127 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.140314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 364/750] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:28.140314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.164535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.165195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.165481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.165765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.166614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.168010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.183304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 387/751] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:28 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:28.184083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.263232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78061513-e8d9-4687-8dd3-48052ae3d685 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.313355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.314158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.314441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.314747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.317277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d5234-4767-4275-92e8-7f374cf8d320 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.323687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.325262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:28.341471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:28.342734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:28.343888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:28.345029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 365/752] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:28.346283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.366735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.368192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.368745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.369296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.382382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.384043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:28.402620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:28.403587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:28.404648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:28.404648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:28.404648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:28.404648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:28.404922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 388/753] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:28.405644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.483239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5984-5e96-4fa7-92f0-8695e2660294 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.518946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.519709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.520189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.520297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.527775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.529220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.529657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654abd6-5e47-4a0b-98ef-adba28c2c495 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:28.545023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:28.545945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:28.546866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:28.550884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 366/754] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:28.551751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.568580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.569537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.569969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.570388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.572035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:28.572544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.574134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.592365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 389/755] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:28.593519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.653082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f623f-0a56-4f21-a625-4658c4394683 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.688518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.689257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.689476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.689755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.691063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:28.691376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.692800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.699297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03ed5-8f04-45f1-9408-02d8b3b79115 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.707124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 367/756] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:28.708106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.736306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.737325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.737814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.738288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.739303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:28.739833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.741554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.754548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 390/757] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:28.755644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.812726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e1b1-6a87-4f11-b7a4-b89519e521b0 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.852512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793309-051a-4384-a865-5476665e4622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.853308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793309-051a-4384-a865-5476665e4622 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.853597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793309-051a-4384-a865-5476665e4622 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.853911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44793309-051a-4384-a865-5476665e4622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.859195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05e2a1-bd50-49f7-8434-f85878a5768a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:28.864421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44793309-051a-4384-a865-5476665e4622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.865870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44793309-051a-4384-a865-5476665e4622 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-44793309-051a-4384-a865-5476665e4622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:28.884666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:28.885602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:28.886507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:28.886507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:28.886507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:28.886507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:28.886507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 368/758] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:28.887231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793309-051a-4384-a865-5476665e4622 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.897610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:28.898719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:28.899205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:28.899698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:28.906891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:28.908551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:28.923129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:28.924014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:28.925463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:28.927918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 391/759] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:28.928971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:28.991281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44793309-051a-4384-a865-5476665e4622 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.026826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.027490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.027776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.028237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.028879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=983fe7993d594683afbc43f4a95885a1) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:29.029252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.030648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.031775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176235b-45d5-4013-b899-657231a3e8ae None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.042365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 369/760] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/role_assignments?user.id=983fe7993d594683afbc43f4a95885a1&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:29.043526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:29.070451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.071498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.072018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.072595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.073554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:29.074063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.075689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.089251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 392/761] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:29.094948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:29.229744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81d18a-7ae5-4583-9dbc-768fc0b4b4ed None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.272112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.273102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.273599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.274139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.275153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:29.276210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.277847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.293860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 370/762] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:29.299610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:29.317847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21549953-e3e6-44f7-8127-1b1b9995b353 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.385944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.386910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.387200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.387476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.395598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.397058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:29.412102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:29.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:29.414006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 393/763] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:29.418979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:29.494240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fec1-c8a8-4ea6-b080-8c2be029cc12 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.556107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.558362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.558882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.559385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.560452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=d61df7a7c5b24a3482bff127f4d63d49) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:29.560963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.562625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.569958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 371/764] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:29 2022] GET /identity/v3/role_assignments?user.id=d61df7a7c5b24a3482bff127f4d63d49&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:29.628707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6b9a-985c-4018-a68b-19442296306b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.685869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.686581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.686870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.687146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.688078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:29.688394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.689914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded9d1-94d1-4805-ac92-2a7be683991b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.707908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 394/765] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:29.715069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:29.846279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552a9a-d80f-4222-a7f5-4e1545a9a079 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:29.892061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:29.892954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.893240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.893542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.896512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=fdcb012cc78d44a2afb7762daa15517c, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:29.897958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64932afc-da8e-467c-8f05-2f0a87f37e2d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:29.917725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 372/766] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:29 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:29.931969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b29f-2ae0-4113-bded-0642f2e7b3ef None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.932264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b29f-2ae0-4113-bded-0642f2e7b3ef None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.932549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b29f-2ae0-4113-bded-0642f2e7b3ef None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.934143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 395/767] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:29.940184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:29.941048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:29.941330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:29.959619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:29.960822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:30.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 373/768] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:30.079266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b29f-2ae0-4113-bded-0642f2e7b3ef None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:30.227196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b29f-2ae0-4113-bded-0642f2e7b3ef None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:30.264803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:30.265599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:30.265882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:30.266158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] PATH_INFO: `/v3/services/network` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:30.266858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:30.268250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:30.287550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:30.288608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:30.289437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 396/769] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:30 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:30.295217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:30.420751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89ded1-544a-4809-8db1-aff5761e0113 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:30.458635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:30.459312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:30.459597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:30.459879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:30.460589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] RBAC: Adding query filter params (name=network) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:30.460894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:30.462272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:30.467183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 374/770] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:30.472828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:30.719567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d49f9e-c3c4-4bc0-a869-2a21e211202a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:30.764246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:30.765022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:30.765197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:30.765469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:30.766182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] RBAC: Adding query filter params (type=network) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:30.766502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:30.767887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aeb09-5463-4b4e-8e06-716417fa0c85 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:30.779475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 397/771] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:30.785845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:30.908641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fdec-8a57-415a-ad63-821784d77e60 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:30.909495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fdec-8a57-415a-ad63-821784d77e60 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:30.909665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69fdec-8a57-415a-ad63-821784d77e60 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:30.911376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 398/772] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:30.920187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:30.920473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:30.920746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:30.943917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:30.945107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:30.973830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ebaf9-7561-4db5-8089-ee6a4fddc65e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:31.031536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:31.033361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.033646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.035223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.036648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] RBAC: Adding query filter params (interface=public, service_id=b393d0bed8654b89a1ede6c14c8b676f, region_id=RegionOne) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:31.036931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:31.042595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:31.057886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 375/773] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:30 2022] GET /identity/v3/endpoints?service_id=b393d0bed8654b89a1ede6c14c8b676f&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:31.070280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:31.138488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 399/774] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:31.200643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:31.286041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dae4d2-64d9-4d4e-a5c2-a12dcd67ae9f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:31.364102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:31.364702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.366299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.366299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.366299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:31.370482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:31.387075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 376/775] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:31 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:31.397231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feaef1-0700-4e97-a1a5-b46c2575f21b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:31.458224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:31.459073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.459352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.459622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.460279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:31.461737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:31.479022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:31.480004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:31.480919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 400/776] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 19:43:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:31.486608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:31.635829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552e9c3-70c5-4a6a-9db9-920232d44e9b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:31.681657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:31.682334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.682648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.682929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.683645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:31.683954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:31.685351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65282dc3-48ef-4a50-b66a-72ac41c2eab3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:31.694874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 377/777] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:31.700406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:31.819469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c35c5-5f6d-465f-914a-e872fdbc1118 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.819469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c35c5-5f6d-465f-914a-e872fdbc1118 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.819469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c35c5-5f6d-465f-914a-e872fdbc1118 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.823843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 378/778] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:31.826696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.826984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.827258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.831682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b10f2-fa76-4da6-8fc0-7987b6eeca2e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:31.853370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:31.854568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:31.872800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:31.873722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:31.874259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:31.874766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:31.875949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:31.876475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:31.878975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:31.885306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 401/779] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:31.895741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:31.983550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 379/780] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:32.008239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad494-6324-432a-ba1b-9b555268cc51 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.017102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.048884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.051236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.051776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.052923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.055106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] RBAC: Adding query filter params (interface=public, service_id=d884b884ad814b06a82112d44ac36481, region_id=RegionOne) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:32.056184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:32.057774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:32.076159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 402/781] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:31 2022] GET /identity/v3/endpoints?service_id=d884b884ad814b06a82112d44ac36481&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:32.081493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.173862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35b60-0aa9-495e-a334-c8266028a3bb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.214643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.215802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.216698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.217202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.229045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:32.238172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:32.239139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:32.239974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:32.243057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 380/782] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:32.255417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.270847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7de9-63c0-413b-aaaf-c8ada401cdd3 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.310491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.310491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.310491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.310491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.311183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:32.312684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187acf4-59c6-460d-a668-44552a0a58a1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:32.320294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 403/783] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:32.389126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e691a9-e744-4275-8c7d-bdc4a852ae45 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.430262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.431194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.431622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.432041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.432971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:32.433435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:32.435005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:32.437274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bb31-b7dc-4c5f-8c66-b937cafd5ee6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.437986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bb31-b7dc-4c5f-8c66-b937cafd5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.437986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bb31-b7dc-4c5f-8c66-b937cafd5ee6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.439865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 404/784] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:32.446103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.446618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.446957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.450403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 381/785] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:32.457107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.474494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:32.474494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:32.546983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 405/786] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:32.570803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.591721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050184-1713-498e-9bfb-7ef1ddc1c5e4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.640638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.643818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.643818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.643818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.669207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:32.670790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:32.700825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:32.701961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:32.703024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:32.703024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:32.703024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:32.703024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:32.705123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 382/787] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:32.710623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7b037-7283-4d35-a4b0-6603579e26f1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.712214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.757336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.758139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.758427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.759095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.773685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:32.786081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:32.787111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:32.788018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 406/788] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:32.799449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:32.855078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81367039-87a5-4837-bbd0-b9627f9a0f96 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:32.907917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:32.908984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:32.910541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:32.912298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:32.913287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:32.914557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:32.916210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:32.931706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 383/789] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:32.937412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.014344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a71d4-8596-4ccd-a199-4949e000c85f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.076267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a229a-bdeb-40f3-aa29-95c2bacf1753 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.078339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.079043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.079329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.079608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.081764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:33.082083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.083505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.099678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 407/790] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:33.105460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.135544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.136340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.136620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.136894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.144721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.146167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:33.184185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:33.185182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:33.186122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:33.189778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 384/791] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:33.193109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.255911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08f626-5768-4ffe-8e06-15f04bb71ca6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.297060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.297936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.298522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.298808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.312505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.314092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca18e-97fc-4720-9331-99dcd5cc3be3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.314781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-5d05eea7-481c-4c1e-8a84-229355f45b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:33.336401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:33.338528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 408/792] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc871-1eea-4b6d-bb52-0e6aa6a63368 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc871-1eea-4b6d-bb52-0e6aa6a63368 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.340650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bc871-1eea-4b6d-bb52-0e6aa6a63368 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.345574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 409/793] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:33.347518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.347808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.348179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.350414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.351204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.351481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.351752 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.352669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:33.352974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.354405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.365671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:33.366960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:33.372830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 385/794] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:33.373717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.442219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 410/795] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:33.443167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.472860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec6ee-72c6-4017-9e6f-15d8f4bf33ab None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.510446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.511133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.511411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.511681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.512394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:33.512693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.514050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.526556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 386/796] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:33.527511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.573033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396378-5a3c-4102-989f-e461aa37ec78 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.607389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.608454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.608896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.609316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.620335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.621971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.625883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0193b5-b412-4e0c-90f2-637d8016ef31 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:33.640757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:33.641683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:33.642600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:33.642600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:33.642600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:33.642600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:33.644893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 411/797] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:33.645974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.659983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.660727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.661007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.661356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.671818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:33.679774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:33.680787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:33.681633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:33.685842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 387/798] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:33.686637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.753432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301528-ce21-455e-8876-132b67e8f079 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.787621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245e562-a174-46de-a03f-c974196f86cb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.788061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.789051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.789480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.789917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.797773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.800244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:33.817075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:33.818284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:33.819386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:33.821939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 412/799] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:33.823254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.824088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.824867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.825244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.825613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.826521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:33.826925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.828871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.841518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 388/800] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:33.842614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.933146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2f38d-d80c-40aa-9034-1a2362b6235b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.953087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09015-0011-4b03-9025-7978bb79075e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:33.969692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.970688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.971070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.971459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:33.972301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:33.972712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:33.974250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:33.987063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 413/801] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:33.988048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:33.997232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:33.998169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:33.998621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:33.999424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.000982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:34.001450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.004029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372b04-b0b1-44b1-a532-4afe2514a8f2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.092935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ae7cf-ece5-4335-8228-b341555a759d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.129286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.130086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.130366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.130695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.138054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.139549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:34.155121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:34.156133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.157034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 414/802] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:34.157518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.175540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 389/803] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:34.177072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf527e-4e00-4c61-9350-e02f0e6ba07a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.177368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf527e-4e00-4c61-9350-e02f0e6ba07a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.177647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf527e-4e00-4c61-9350-e02f0e6ba07a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.179037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 390/804] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:34.181124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf527e-4e00-4c61-9350-e02f0e6ba07a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.264247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bba23b-865b-49de-855d-5ad1eeb04c52 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.281258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf527e-4e00-4c61-9350-e02f0e6ba07a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.298029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.298844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.299128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.299935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.309569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.311043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.313743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.314392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.314714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.315012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.316211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:34.316763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.318852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-1fd59706-9c78-4e73-a08c-0102f685308b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:34.330169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:34.331788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:34.337861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:34.337861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:34.337861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:34.337861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.338088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 391/805] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:34.338088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.338218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 415/806] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:34.339100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.339388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.339661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.360203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:34.361322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:34.438490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e50b-2c61-4309-ab08-c11479778e1b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.438829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 416/807] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:34.439711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.472061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.472848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.473127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.473397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.483746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.485185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:34.503222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:34.504132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:34.505036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:34.505036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:34.505036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:34.505036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:34.505036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 392/808] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:34.505742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.549185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39972-9ae5-43b3-b553-0141031bfedd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.585438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.586426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.586799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.587074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.587796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:34.588101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.589463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.605376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 417/809] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:34.605376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.617320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532ef98-da00-4ada-be4e-4d1049dc8372 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.650167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.651424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.651908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.652362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/983fe7993d594683afbc43f4a95885a1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.654519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=983fe7993d594683afbc43f4a95885a1, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.656110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.671326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 393/810] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:34 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/983fe7993d594683afbc43f4a95885a1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:34.672415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.727857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a6d6c-053f-4c89-b56a-4e0dc9c4665c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.783560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.785243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.785709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.786163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] PATH_INFO: `/v3/services/network` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.787070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.788809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.790110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7d61-da4d-445c-859b-828465960e8e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:34.802176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:34.803378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 19:43:34.804216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.807266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 418/811] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:34.808343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.828006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.828739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.829025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.829300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.830038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:34.830343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.831904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.845576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 394/812] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:34.847119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.916967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d51cb-956e-49cc-b4c4-b05372c9fe98 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.952216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e82e-a930-45c6-9b0a-af327082e919 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:34.952648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.953679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.954161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.954665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.962956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.964801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:34.978806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:34.979775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:34.980742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 419/813] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:34.981336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:34.992352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:34.993260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:34.993260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:34.993554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:34.994256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] RBAC: Adding query filter params (name=network) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:34.994722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:34.995972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f822b-9c85-447b-b1d7-fcbe74a3ab8c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 395/814] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8174-1885-4fc9-a37e-eed24e9d0a55 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8174-1885-4fc9-a37e-eed24e9d0a55 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa8174-1885-4fc9-a37e-eed24e9d0a55 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 396/815] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:35.005679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa8174-1885-4fc9-a37e-eed24e9d0a55 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.087590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8412-4b41-45cd-8018-183acbbc35ce None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.120164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa8174-1885-4fc9-a37e-eed24e9d0a55 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.120785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.121584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.121868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.122147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.129844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.131326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:35.145865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:35.146808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:35.147717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 420/816] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:35.148280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.160604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.161278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.161562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.161877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.162706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:35.163019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.164528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917831d5-59cc-4a22-b841-397f958858c2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.181979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 397/817] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:35.183610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.183967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.184318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.200178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:35.201439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:35.251442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779ea51-ef86-4fb9-a824-99319e2163f4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.267860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 398/818] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:35.269418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.293032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.294510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.294972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.295559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.296739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] RBAC: Adding query filter params (type=network) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:35.297198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.298739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.308087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 421/819] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:35.308087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.365619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8c8a-569c-4616-a163-6531a2fd30ab None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.400798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.401453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.401735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.402011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.402830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:35.403140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.404561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.406013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c5c6a-023b-4a53-bc3c-39a12b93905d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.420332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 399/820] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:35.420332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.444064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.444650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.444935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.445219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.511112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.512570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.520665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7faa-bce0-4b73-894b-f06493988edd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.556409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.557214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.557498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.557773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.558420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.559808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:35.572316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:35.573272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:35.574126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 400/821] 10.222.0.57 () {56 vars in 1129 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:35.574995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.613126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 422/822] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:43:35.613946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.678577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f701-e846-4d66-8a5a-897895b30a9c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.709555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3cdf1-6fcb-43a5-a13f-0153f5b70016 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.716163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.717536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.718361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.718901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.719803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.721982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.745318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.746200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.746496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.746776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/d61df7a7c5b24a3482bff127f4d63d49/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.747390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 401/823] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:35.748390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.783005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=d61df7a7c5b24a3482bff127f4d63d49, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.785078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.804235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 423/824] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:35 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/d61df7a7c5b24a3482bff127f4d63d49/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:35.805371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:35.926717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313c90-5ac7-4c27-b7c2-a2b627c6fa3b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.959851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3fa45-6cbc-47a5-8ac1-51c2715f5c40 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:35.967834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.968865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.969295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:35.969777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:35.981126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:35.982641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:35.998110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:35.999408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:35.999869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.001655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.003176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:36.003315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:36.004319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:36.005388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:36.005388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:36.005388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:36.005388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:36.005388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 424/825] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:36.006173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.007751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.011354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.014078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 402/826] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:36.019293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.135687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1936-1226-41cb-b3af-c650584ba83d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.140310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0e4f-16ef-4e64-a51a-3db6a076dbc6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.180841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.182251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.183172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.184026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.185215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:36.186182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.186974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.187788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.188141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.188364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.188772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.189646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:36.190690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.192197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.200103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 403/827] 10.222.0.57 () {56 vars in 1124 bytes} [Tue May 10 19:43:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:36.201064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.205057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 425/828] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:36.210646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.320836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bbddd-0f3c-4b61-bcb0-b4e17991b854 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.329054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895d98-f661-40ad-b3ae-c2587fce2646 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.366975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.368002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.368424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.368847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.369723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.371318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.375619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.376524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.376906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.377333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.385067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.386681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.393898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 404/829] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:36.411867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:36.412834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:36.413711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 426/830] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:36.419335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.544584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c5423-f88a-477a-a501-a2a5ac6c79b7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.582566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.583243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.583536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.583804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.584603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:36.584912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.586366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f77036-d571-4e8e-ae9f-f87b27e6b156 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.599647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 405/831] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:36.605429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:36.706268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915d44-4c2b-466e-a4ff-b95b9d11edd5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:36.740137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:36.741096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:36.741559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:36.742012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:36.743069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:36.743562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:36.745182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf3c0c-2566-4468-8efb-147ac9e1b503 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:36.751994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 427/832] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:36 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:37.033364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d3c5-2a6a-4125-b1a6-707348576246 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.034504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d3c5-2a6a-4125-b1a6-707348576246 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.034504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0d3c5-2a6a-4125-b1a6-707348576246 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.036165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 406/833] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:37.042328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.042328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.042328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.060962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:37.062386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:37.133872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 428/834] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:37.157755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d3c5-2a6a-4125-b1a6-707348576246 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:37.262024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0d3c5-2a6a-4125-b1a6-707348576246 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:37.296563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:37.297685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.298172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.298677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.309989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:37.317995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:37.319202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:43:37.320066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:37.326551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 407/835] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:37.328803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:37.425631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75950e-1855-41e8-a673-cf878d7ea597 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:37.458708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:37.459688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.460177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.460652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.461641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:37.462148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:37.463736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:37.476739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 429/836] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:37.478317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:37.581698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6533-75d5-463f-a95b-7f5b06f9a0a8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:37.616152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:37.617293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.617778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.618295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.630402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:37.632167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:37.649908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:37.650946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:37.651840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:37.651840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:37.651840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:37.651840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:37.659168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 408/837] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:37.661141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:37.764732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a731b-54fb-45fc-963c-3604b828ca23 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:37.804413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:37.805088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.805375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.805651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.806385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:37.806721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:37.808105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:37.821091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 430/838] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:37.826727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:37.930975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d29e1-e94c-47f6-9438-2ff30539fe30 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:37.967408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:37.968584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:37.969068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:37.969543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:37.977901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:37.979636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:37.994584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:37.995538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 19:43:37.996591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:38.003031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 409/839] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:43:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:38.005916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.108043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df356fae-fcd5-4117-b963-74a8ff9dc01d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.148040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.149261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.149755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.150226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.151354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:38.151882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.153507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cf92d-e6b8-45a5-8b32-92679bab1e06 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.176869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 431/840] 10.222.0.57 () {56 vars in 1135 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:38.178484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.259680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047197-6089-41ab-a24b-c35c96822c69 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.260036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047197-6089-41ab-a24b-c35c96822c69 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.260240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047197-6089-41ab-a24b-c35c96822c69 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.261856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 432/841] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:38.267155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.267662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.268193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.285101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686454d-bf3f-4ac6-ac4c-a20569c25fe9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.298361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:38.300567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:38.322996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.323980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.324874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.325365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.386632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 433/842] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:38.406413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.408193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.410878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.525090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 410/843] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:43:38.527476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.529855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be8e95-3934-4efe-b8d7-a1cbaef2bdbc None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.573346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.574450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.574931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.575383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.588381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:38.598872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:38.599780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:43:38.600613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:38.603837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 434/844] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:38.609072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.644386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db2fad-2ae2-4ef6-8727-5b7699286ae2 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.682323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.683460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.683874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.684282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.695615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.697720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:38.717025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:38.718088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:38.718992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:38.718992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:38.718992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:38.718992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:38.719218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f88056-afae-447c-aba5-c10c63bafbc3 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.725746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 411/845] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:38.727363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.753812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.754624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.755011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.755657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.757040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:38.757701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.759633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.776126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 435/846] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:38.777202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.829629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7686-422c-4d34-bb02-f3dbd45a56b1 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.867121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.867807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.868093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.868629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.869099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:38.869407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.870839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b6cd-8b47-47f1-b6b7-e0bd4762e8a8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.878096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10facee-af35-4397-bc33-c9aacf157b93 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:38.890176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 412/847] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:38.890176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863c4c-8036-4ee9-b04c-a1a85aedc547 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.890176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863c4c-8036-4ee9-b04c-a1a85aedc547 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.890176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65863c4c-8036-4ee9-b04c-a1a85aedc547 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.890176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 413/848] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:38.892533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65863c4c-8036-4ee9-b04c-a1a85aedc547 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:38.921796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:38.922723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.923080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.923365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.934603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:38.936055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-aa0e32fc-0045-460c-878d-d3e86c12d3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:38.956627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:38.957536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:38.958403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:38.958403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:38.958403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:38.958403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:38.959100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 436/849] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:38.960343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:38.960632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:38.960928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:38.978561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:38.979748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:39.004146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65863c4c-8036-4ee9-b04c-a1a85aedc547 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.036924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.037629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.037904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.038177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.045149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.046750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.050507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 437/850] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:39.050507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c89fb607-1604-4a0c-a278-78e51cb25d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:39.065079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:39.066148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:39.067222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:39.069487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 414/851] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:39.071501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5399-de5c-45ba-b644-290085e8ac0a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.071792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5399-de5c-45ba-b644-290085e8ac0a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.072069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5399-de5c-45ba-b644-290085e8ac0a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.073459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 415/852] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:39.076053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5399-de5c-45ba-b644-290085e8ac0a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.152380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272de6b-3839-459e-b812-ceb6c0790d63 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.172678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5399-de5c-45ba-b644-290085e8ac0a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.183574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.184227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.184506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.184775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.185486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.185788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.187169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.198276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 438/853] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.199085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.209872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.210555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.210837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.211108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.211876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.212180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.213591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219981e-fba8-4d8d-acf5-6142e1d16286 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.224690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 416/854] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:39.225859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.226144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.226421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.241955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:39.243157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:39.298047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d972d-5e6b-4f52-ab7f-eb6c3e366cca None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.306614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 417/855] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:39.307429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.332837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.333631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.333912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.334183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.334934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.336298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:39.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:39.349355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:39.350627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 439/856] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:39.351608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.403827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f9a4-a2a5-43a8-960c-654834de7901 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.435452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.436245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.436527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.436794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.443674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.444553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d470d-923f-4169-a5bf-c3e6ac50874e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.445098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:39.460768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:39.461954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:39.462936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 418/857] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:39.463518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.480242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.480895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.481179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.481455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.482274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=983fe7993d594683afbc43f4a95885a1) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.482614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.484037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.489630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 440/858] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/role_assignments?user.id=983fe7993d594683afbc43f4a95885a1&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.490398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.591663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c660d6-fc2c-4ef7-af9d-18814f96b308 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.601865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50842837-a8d8-4fb3-88c2-40f0209dcaec None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.629560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.630388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.630708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.630984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.631651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.633053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.638883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.639556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.639840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.640113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.640829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.641136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.642556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:39.646137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:39.647104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:39.648032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 419/859] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:39.648945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.659318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 441/860] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.659318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.756263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d735b5-a824-45f0-9325-0f8761b68bef None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.761337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809305ef-25a7-4ad7-a09a-1dd6ddf8c814 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.788602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.789257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.789534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.789805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.790656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.790961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.792366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.793798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.794473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.794771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.795051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.795763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.796073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.797433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.802206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 442/861] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.803106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.818849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 420/862] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.818849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.903992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988de4-2664-4f4d-90fe-b2736c978e30 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.915069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226241e-5d7a-4bbb-9ee7-2b7f7fd1c203 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:39.937374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.938031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.938315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.938631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.939541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.940396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.941768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.946407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 443/863] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:39.947310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:39.960555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:39.962147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:39.962631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:39.963090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:39.964228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:39.965171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:39.967194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:39.974320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 421/864] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:40.064602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cf736-eb27-4290-a677-336146b0b259 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:40.103633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:40.104309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:40.104592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:40.104868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:40.185813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:40.187630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:40.289027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 444/865] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:43:40.294768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:40.398945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5cdd6-11e8-4859-a1c2-e4986fcf9057 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:40.433939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75903c61-f622-48c3-800e-610516c4487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:40.434775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903c61-f622-48c3-800e-610516c4487d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:40.435061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903c61-f622-48c3-800e-610516c4487d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:40.435341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75903c61-f622-48c3-800e-610516c4487d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:40.446317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75903c61-f622-48c3-800e-610516c4487d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:40.447735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75903c61-f622-48c3-800e-610516c4487d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-75903c61-f622-48c3-800e-610516c4487d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:40.468361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:40.469516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:40.470650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:40.470650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:40.470650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:40.470650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:40.470650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 422/866] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:40.476595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:40.583344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159c66-5f2d-42ef-9112-bb2edf467638 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:40.617305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:40.617968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:40.618250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:40.618552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:40.619270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:40.619577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:40.620948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:40.632763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 445/867] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:40.638033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75903c61-f622-48c3-800e-610516c4487d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:40.741006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75903c61-f622-48c3-800e-610516c4487d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:40.780255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:40.781405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:40.781905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:40.782390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:40.790058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:40.791767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:40.805938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:40.806902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:40.807787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:40.810291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 423/868] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:40.816749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:40.918148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef1262-87a8-499c-9f15-e68e469c2b04 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:40.951548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:40.952485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:40.952997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:40.953502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:40.954518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:40.955041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:40.957335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399767f-9a5f-4967-89c0-ce0b47a013fb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:40.969814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 446/869] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:40.979251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:41.093670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26f4d-709f-4ce6-a2a6-a68ebf1bcb03 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:41.128233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:41.129211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:41.129720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:41.130189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:41.131240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=d61df7a7c5b24a3482bff127f4d63d49) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:41.131758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:41.133411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c3479-9d1f-464f-b8cc-eb62f85c8a0a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:41.140791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 424/870] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:40 2022] GET /identity/v3/role_assignments?user.id=d61df7a7c5b24a3482bff127f4d63d49&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:41.870105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a70a-918c-49ad-bb60-03fefbb33c25 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:41.870615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a70a-918c-49ad-bb60-03fefbb33c25 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:41.870615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a70a-918c-49ad-bb60-03fefbb33c25 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:41.872211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 447/871] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:41.878044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:41.878486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:41.878668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:41.895676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:41.896862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:41.963474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 425/872] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:41.984987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a70a-918c-49ad-bb60-03fefbb33c25 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:42.093938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856a70a-918c-49ad-bb60-03fefbb33c25 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:42.131012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:42.131755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.132040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.132318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.132990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:42.134419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-40763114-eb43-4aa2-ac6a-e31a5ae2b311 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:42.151787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:42.152842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:42.153668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:42.156721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 448/873] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:42.163099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:42.258084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114c1c-a19e-422d-b384-b9ca26deb3e6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.258432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114c1c-a19e-422d-b384-b9ca26deb3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.258683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114c1c-a19e-422d-b384-b9ca26deb3e6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.259653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237cfb-58a6-4641-941b-26770fafc9be None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:42.260171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 449/874] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:42.266417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ca14-af8a-4df9-82c2-67cce8785226 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.266878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ca14-af8a-4df9-82c2-67cce8785226 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.267163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ca14-af8a-4df9-82c2-67cce8785226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.284987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3359ca14-af8a-4df9-82c2-67cce8785226 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:42.286521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3359ca14-af8a-4df9-82c2-67cce8785226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:42.297852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:42.298542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.298825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.299159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.299863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:42.300167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:42.301536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:42.310525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 426/875] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:42.311386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:42.363084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 450/876] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:42.371971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbec2-4241-4ba4-97dd-083991cf3962 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.372266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbec2-4241-4ba4-97dd-083991cf3962 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.372545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbec2-4241-4ba4-97dd-083991cf3962 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.378981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 451/877] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:42.380231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.380622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.381003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.399048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:42.400546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:42.414536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139586c-1913-4c15-9578-dbf9793a3537 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:42.457270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:42.458095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.458638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.458944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.459663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:42.459968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:42.461427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:42.466527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 427/878] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:42.467403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:42.478755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 452/879] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:42.498306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:42.598352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14baf9d-94c0-40a3-a80f-850a07d3b331 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:42.626407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3fd17-b87b-40db-923e-7368c7713d01 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:42.636287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:42.636956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.637232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.637503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.638550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:42.639730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa619-bc3e-49f6-88c5-1c2b46f31c6f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:42.658837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 428/880] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:42 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:42.675707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:42.676517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:42.676866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:42.677213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:42.678040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:42.679609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dac0c0-af5e-446f-8450-c978e65377cc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:42.697081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 453/881] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:42 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:43.560487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374f4-daab-4fda-ba68-7c95903bf70b None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:43.560992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374f4-daab-4fda-ba68-7c95903bf70b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:43.561112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a374f4-daab-4fda-ba68-7c95903bf70b None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:43.562642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 429/882] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:43.568455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:43.568876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:43.569014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:43.586449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:43.587680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:43.659787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 454/883] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:43.683047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a374f4-daab-4fda-ba68-7c95903bf70b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:43.788427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a374f4-daab-4fda-ba68-7c95903bf70b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:43.822936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:43.823743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:43.824020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:43.824291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:43.834797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:43.843044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:43.844055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:43.845158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 430/884] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:43:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:43.851001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:43.952811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d278-fa97-4af4-8fc6-d0d9ebc82db8 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:43.987610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:43.988284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:43.988568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:43.988844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:43.989595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:43.989903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:43.991305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:43.999789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 455/885] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:43:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:44.006036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:44.105865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270d5e6-ac4a-4cd2-8863-89a27b4e6ac9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:44.142019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:44.142859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.143147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.143428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.154032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:44.155508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:44.172135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:44.174765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:44.177024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:44.177024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:44.177024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:44.177024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:44.177024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 431/886] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:44.180538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:44.280346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390a3fd-9d81-4ccf-a2ae-336eb72fd0ab None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:44.314420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:44.315755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.316042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.316317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.317043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:44.317352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:44.318766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:44.331447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 456/887] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:44.336939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:44.445300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950134a1-93ca-4bdd-a420-a1e8f155d824 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:44.482216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:44.483194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.483388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.483707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.493344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:44.494829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:44.510750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:44.512983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:44.515310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 432/888] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:44.519730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:44.619467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ac44-53a4-4563-b3ec-05b48f197c3a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:44.658903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:44.659601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.659886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.660160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.661019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:44.661448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:44.664953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc19c9d-62b0-4042-a8cb-54c9fb314961 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:44.682161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 457/889] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:44.689208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:44.794207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4b7c4-be32-44d6-9635-733eb939e17c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:44.828015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135ee8-14f1-4b96-aabf-ba81890d0730 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.828380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135ee8-14f1-4b96-aabf-ba81890d0730 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.828586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135ee8-14f1-4b96-aabf-ba81890d0730 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.830686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 458/890] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:44.833095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:44.833790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.834148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.834438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.838348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:44.838746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:44.839030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:44.864130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:44.865643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:44.916321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:44.918093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4361-09bd-49eb-97c8-384102c99406 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:44.942847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 459/891] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:44.958994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.019199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 433/892] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:43:45.020859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11410-6756-4d0a-b6df-6c6b038f15dd None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.021334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11410-6756-4d0a-b6df-6c6b038f15dd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.021805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11410-6756-4d0a-b6df-6c6b038f15dd None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.023293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 434/893] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:45.025899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f11410-6756-4d0a-b6df-6c6b038f15dd None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.068514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85410-b534-4e6d-9ae0-0f79199f4297 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.101231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.101892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.102177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.102453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.103194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.104604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb192ab-3d80-4874-87f8-81d5598635b4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.120367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 460/894] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:44 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:43:45.121659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d73c-1397-409f-9019-d4a12af9a8cd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.122006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d73c-1397-409f-9019-d4a12af9a8cd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.122292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d73c-1397-409f-9019-d4a12af9a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.140038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2c20d73c-1397-409f-9019-d4a12af9a8cd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:45.141260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2c20d73c-1397-409f-9019-d4a12af9a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:45.143543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f11410-6756-4d0a-b6df-6c6b038f15dd None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.179532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.180396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.180680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.180959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.193005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.194501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-beebdf99-438c-4e98-b5e6-3cc6101fc3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:45.213846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:45.215008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:45.215995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:45.215995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:45.215995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:45.215995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:45.215995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 435/895] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:45.216843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad8f-663d-471d-b1b9-52568a459198 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.216843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad8f-663d-471d-b1b9-52568a459198 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.217022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad8f-663d-471d-b1b9-52568a459198 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.218433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 436/896] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:45.221267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dad8f-663d-471d-b1b9-52568a459198 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.226571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 461/897] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:45.228127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.228425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.228711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.248700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:45.249930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:45.322780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 462/898] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:45.326490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.339984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dad8f-663d-471d-b1b9-52568a459198 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.374445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.375399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.375682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.375956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.376680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:45.376987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.378973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.390033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 437/899] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:45.390888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.431975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187107-2a4a-4cc8-b4b4-2ef69714405d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.466803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.467951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.468457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.468935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.469817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.471434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:45.483569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:45.484910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:45.485941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:45.489026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 463/900] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:45.489979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.498930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1ec42-bc20-4eb5-ae02-0ac3b7f028ce None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.532632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.533521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.533796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.534077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.534766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.536134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:45.548177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:45.549751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:45.551100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 438/901] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:45.551967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.605159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5d77-4e6b-4ef4-a595-9a21dcd5b07e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.639230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.640027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.640316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.640584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.647395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.648842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.652701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86022ff3-348c-4a81-a90d-ea8b686f233e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:45.663547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:45.664503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:45.665420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 464/902] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:45.665928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.700127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.701075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.701538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.701994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.703274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:45.703785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.706615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.713873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 439/903] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:45.719373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.786297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604397a-d70a-4ae8-beb6-edad331ae5ed None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.817518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68ac-c8a6-49f2-aebf-70ad34d0e860 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.819845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.820512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.820793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.821068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.821771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:45.822076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.823476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.828700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 465/904] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:45.829420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.855321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.855922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.856207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.856483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.857268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:45.857578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.859050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.875796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 440/905] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:45.875796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:45.933856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb09f-522c-49e7-8c90-14590086f56c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.967304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:45.967994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:45.968278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:45.968554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:45.969248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:45.969555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:45.971565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:45.972989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f845c3-a5eb-4721-9db0-452140e8ac22 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:45.981268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 466/906] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:45.981268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:46.009359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.010018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.010294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.010596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.011286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:46.011583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.012920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.021988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 441/907] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:46.021988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:46.085064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405d07-f7dc-417a-a93e-b42c845aaccc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:46.117517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a363bb-ba9a-4379-ab39-9b62e7fe80cb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:46.117784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.118374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.118684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.118978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.119793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] RBAC: Adding query filter params (role.id=5a759fff33284cab93447790f0cd1a96, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=d61df7a7c5b24a3482bff127f4d63d49) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:46.120105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.121536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.138496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 467/908] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:45 2022] GET /identity/v3/role_assignments?user.id=d61df7a7c5b24a3482bff127f4d63d49&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=5a759fff33284cab93447790f0cd1a96 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:46.138496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:46.169017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.169786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.170067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.170345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.171185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] RBAC: Adding query filter params (interface=public, service_id=c69921e50b3e4fa9be7a394c39da581d, region_id=RegionOne) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:46.171498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.172893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.179459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 442/909] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:46 2022] GET /identity/v3/endpoints?service_id=c69921e50b3e4fa9be7a394c39da581d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:46.184593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:46.251373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09a18-4b7a-4598-96e9-54ab73015621 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:46.289729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.290407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.290725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.291005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.291813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] RBAC: Adding query filter params (interface=public, service_id=ee4cd9df24cb4cfe95e13e85d8767548, region_id=RegionOne) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:46.292127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.293537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.294296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3722-d05c-4482-aca7-80ad40e0038e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:46.304555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 468/910] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:46 2022] GET /identity/v3/endpoints?service_id=ee4cd9df24cb4cfe95e13e85d8767548&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:46.305487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:46.332468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.333479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.333977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.334442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.335431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.336985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53414cd-f9e1-4aa1-99ce-4eda1e1ce90a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.343643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 443/911] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:46 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:43:46.415593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44d793-d277-4a27-86a2-024f553839c8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:46.457411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:46.458537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:46.459021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:46.459505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:46.460399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:46.462186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca2d17-24fb-462f-ba93-d66481e3e875 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:46.471526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 469/912] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:46 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:43:47.401624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965644-d9a5-4795-92d3-cddf9d3fe54c None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:47.402180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965644-d9a5-4795-92d3-cddf9d3fe54c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:47.402180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8965644-d9a5-4795-92d3-cddf9d3fe54c None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:47.403819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 444/913] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:47.409413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:47.409805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:47.409987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:47.426430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:47.427780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:47.496887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 470/914] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:47.520338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8965644-d9a5-4795-92d3-cddf9d3fe54c None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:47.629353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8965644-d9a5-4795-92d3-cddf9d3fe54c None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:47.663504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:47.664299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:47.664576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:47.664922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:47.665617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:47.667149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:47.679581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:47.680600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:47.681439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 445/915] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:47.687119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:47.786188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698687-712c-465a-86f3-0e6bcf893325 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:47.820959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:47.821623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:47.821903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:47.822176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:47.822915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:47.823219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:47.824594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:47.829998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 471/916] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:47.835923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:47.941600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d27584-f92e-40c3-b9bb-a3e167f413d4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:47.975334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:47.975996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:47.976274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:47.976547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:47.977241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:47.977540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:47.978921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:47.983999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 446/917] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:47.990308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.090611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe462d9-4436-4c1f-b3da-b1698093d457 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:48.125352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:48.126006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.126284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.126583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.127918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] RBAC: Adding query filter params (interface=public, service_id=cda34479ba0040cba99c25cfbc012a1a, region_id=RegionOne) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:48.128266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:48.129732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1844c-71cc-4c7a-bde2-dedd1ad30c85 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:48.135355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 472/918] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:47 2022] GET /identity/v3/endpoints?service_id=cda34479ba0040cba99c25cfbc012a1a&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:48.140815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.256924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0090f-ea7b-4ab7-8003-ac4441e4375f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:48.291914 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:48.292575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.292855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.293130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.293809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:48.295659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd94418-6f76-4cba-86ef-18f8f693b147 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:48.303530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 447/919] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:48 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:43:48.406427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678cec-2c34-4f20-8466-ff0bd8ab9821 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.406829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678cec-2c34-4f20-8466-ff0bd8ab9821 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.407017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70678cec-2c34-4f20-8466-ff0bd8ab9821 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.408783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 473/920] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:48.414622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.415240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.415240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.434062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:48.435309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:48.511031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 448/921] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:48.539674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678cec-2c34-4f20-8466-ff0bd8ab9821 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.647785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70678cec-2c34-4f20-8466-ff0bd8ab9821 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:48.682568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:48.683634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.684066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.684516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.695111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-4f4f4f79-2599-406b-a850-1b2e449ec462 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:48.703298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:48.704427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:48.705983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:48.712974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 474/922] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:43:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:48.715564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.719773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78be7-ab50-4e91-8dcd-7bdf40a8b368 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.720518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78be7-ab50-4e91-8dcd-7bdf40a8b368 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.720518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78be7-ab50-4e91-8dcd-7bdf40a8b368 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.722545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 475/923] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:48.730083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880eb0-c881-4ae2-89e9-8b1d7167938b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.730083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880eb0-c881-4ae2-89e9-8b1d7167938b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.730083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880eb0-c881-4ae2-89e9-8b1d7167938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.749643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-59880eb0-c881-4ae2-89e9-8b1d7167938b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:48.751610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-59880eb0-c881-4ae2-89e9-8b1d7167938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:48.820043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d5ad-898c-4731-b32b-95ece177d878 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:48.829252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 476/924] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:48.831711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd340bb-403f-4634-9b42-61971456be74 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.832000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd340bb-403f-4634-9b42-61971456be74 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.832275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd340bb-403f-4634-9b42-61971456be74 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.833731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 477/925] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:48.839097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.839385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.839666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.859303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:48.860478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:48.861654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:48.862434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:48.862644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:48.862953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:48.863867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:48.864000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:48.865353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:48.874632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 449/926] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:43:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:48.875731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.930155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 478/927] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:48.938752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:48.991127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e9f98-362b-4a81-9278-57621f5117f9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.026602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.027662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.028127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.028257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b817c-64cd-48ca-9fdf-a66db9c0b608 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.028711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.029537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.031129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:49.043587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:49.044843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 19:43:49.045894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.046843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 450/928] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:49.047443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.071502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.072211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.072492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.072766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.083136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.084582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:49.101873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:49.102804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:49.103727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:49.103727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:49.103727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:49.103727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:49.106633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 479/929] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:49.108190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.156930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04508-4cc7-4c89-a04d-5948298790aa None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.191963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.192771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.193048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.193316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.193962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.195343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:49.207775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:49.208719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:49.209560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 451/930] 10.222.0.57 () {56 vars in 1132 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:49.210410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.213157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47889-aadd-40ee-ab90-5ea579213373 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.246898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.247920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.248437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.248918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.249833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.250642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.252132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.257359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 480/931] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.258150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.316500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77f0a-9312-4faf-a0fd-e4f9555fbcb8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.356223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.356801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.357081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.357352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.358060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.358361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.358885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49aa2-237d-429f-9f23-ec2fbd39f94d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.359788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.372214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 452/932] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.373040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.398310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.399220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.399682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.399959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.400658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.400962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.402322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.412379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 481/933] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.412379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.476783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31067ae-e996-4af4-80ce-225578336085 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.509155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14edc-3964-4ed7-bcd9-d123ec76b93b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.513267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.513934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.514215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.514513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.515216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.515520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.516877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.522443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 453/934] 10.222.0.57 () {56 vars in 1114 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.523257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.550570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.551439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.551729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.552002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.559535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.561038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:49.576199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:49.577183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 482/935] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:49.583357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.625329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd7d3-e0f1-4ffa-a736-1ca5fd542b1c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.658787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.659453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.659798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.660079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.660777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.661086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.662439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.671566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 454/936] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.671566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.683591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f94e-be7a-411b-bdce-acf744f53f76 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.716841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.717498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.717787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.718064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.718837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.720214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.741278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 483/937] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:49.743817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.770295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb904b9-3edd-4f20-9f88-02c4058e8526 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.816420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.817471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.817471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.818007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.818818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:49.819191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.820877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.846428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 455/938] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:49.847534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:49.888260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4633cbe-fce4-401c-8022-c6d34d4b0502 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:49.933239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:49.934240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:49.934727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:49.935182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:49.936502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:49.938422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:49.961834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 484/939] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:49.970005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d608d8f-eb67-4ea2-a65c-0ec8157656bb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.017045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.017889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.018172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.018450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.030301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.031860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:50.052052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:50.053112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:50.054030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:50.054030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:50.054030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:50.054030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:50.054030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 456/940] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:50.060782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:50.174846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891815-3079-4c24-a2c0-00045634a1a5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.220040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.221269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.221558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.221834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.222590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:50.222899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.224337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.237613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 485/941] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:50.242999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:50.346888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de763-c003-4a54-98f3-b9e073cbcdf7 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.381926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.383203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.383701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.384168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.391344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.393590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:50.407615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:50.409066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:50.409954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:50.412444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 457/942] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:50.418364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:50.526702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14049148-9f61-4d87-887a-c87af7c663d5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.561963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.562781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.563036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.563309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.564097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:50.564434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.565862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7edc01-8447-44c3-a43e-cc674389a72e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.582598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 486/943] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:50.584426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:50.680275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b3d6-6cb7-4325-9c1b-509f7d10b7ba None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.680944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b3d6-6cb7-4325-9c1b-509f7d10b7ba None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.681281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b3d6-6cb7-4325-9c1b-509f7d10b7ba None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.686505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 487/944] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:50.690619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88fb8-f3ef-4a1b-a577-dcfc27d6ab13 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.691980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.692270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.692550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.708800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:50.709973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:50.724128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.725012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.725295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.725570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/d61df7a7c5b24a3482bff127f4d63d49/roles/5a759fff33284cab93447790f0cd1a96` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.727791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=d61df7a7c5b24a3482bff127f4d63d49, role_id=5a759fff33284cab93447790f0cd1a96)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.729217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.746559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 458/945] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:43:50 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/d61df7a7c5b24a3482bff127f4d63d49/roles/5a759fff33284cab93447790f0cd1a96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:43:50.801200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 488/946] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:50.825040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:50.936168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05718a7a-9bd3-4604-843e-10f40df137e5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:50.978879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:50.979695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:50.979976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:50.980251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:50.980905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:50.982275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:50.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:50.995471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:50.996325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 459/947] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:51.004052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:51.104180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d9bfa-2f26-40c3-91f6-f9556f013372 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:51.138880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:51.139544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:51.139828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:51.140161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:51.140862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:51.141221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:51.143294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:51.148455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 489/948] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:51.154000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:51.256063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec8350-49e7-47a9-8ae5-7ba0986f1156 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:51.289880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:51.290565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:51.290850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:51.291126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:51.291834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:51.292139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:51.293500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89da304-621c-4c4a-aa27-a3527d5d40f1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:51.298646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 460/949] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:51.304808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:51.409352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54146fc-d36f-4ddb-ac94-5edb561bf72e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:51.443876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:51.444528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:51.444811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:51.445084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:51.445829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:51.447216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91723e-117b-40de-a835-197b2d0abf57 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:51.466992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 490/950] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:43:52.129270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cf67c-a674-46a1-9a64-7e845a471ff2 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.129823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cf67c-a674-46a1-9a64-7e845a471ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.130044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cf67c-a674-46a1-9a64-7e845a471ff2 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.131717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 461/951] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:52.137076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426916-3b0e-4b1a-b88a-dc775c314bee None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.137865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426916-3b0e-4b1a-b88a-dc775c314bee None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.138358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426916-3b0e-4b1a-b88a-dc775c314bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.156886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-af426916-3b0e-4b1a-b88a-dc775c314bee None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:52.159004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-af426916-3b0e-4b1a-b88a-dc775c314bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:52.237374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 491/952] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:52.261106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cf67c-a674-46a1-9a64-7e845a471ff2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.364389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cf67c-a674-46a1-9a64-7e845a471ff2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:52.385821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e1fe-5e16-4365-9e5d-ef60827cc3ee None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.386092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e1fe-5e16-4365-9e5d-ef60827cc3ee None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.386290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e1fe-5e16-4365-9e5d-ef60827cc3ee None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.387931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 492/953] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:52.393354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.393641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.393915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.401612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:52.402568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.403073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.403548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.404862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:52.406839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:52.408985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING keystone.server.flask.common [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 19:43:52.410615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:52.411746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:52.431600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.sql.core [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:43:52.431600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 19:43:52.431600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [parameters: {'id': 'a58a21234cb74bf8a6d27e360b25f18b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 19:43:52.431600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79896) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a58a21234cb74bf8a6d27e360b25f18b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a58a21234cb74bf8a6d27e360b25f18b. May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:43:52.442801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 19:43:52.443746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application yield resource May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise self.value May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application session.commit() May 10 19:43:52.444834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.flush() May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application compat.raise_( May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:43:52.445833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:43:52.446882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:43:52.448054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [parameters: {'id': 'a58a21234cb74bf8a6d27e360b25f18b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.449132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:52.450215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a58a21234cb74bf8a6d27e360b25f18b. May 10 19:43:52.451298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.453754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 462/954] 10.222.0.57 () {60 vars in 1140 bytes} [Tue May 10 19:43:52 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:52.461366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.500287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 493/955] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:52.517093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.583658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7b2c2-6ec7-4f0f-b810-e6628f2998eb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:52.626634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:52.627819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.628338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.628829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.634031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a33ed-5193-40e1-88aa-ab5bcbadf7ca None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:52.638084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:52.640009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:52.655477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:52.656404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:52.657281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:52.660268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 463/956] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:52.665623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.674228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:52.675342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.675821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.676286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.677153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:52.678909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:52.692690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:52.693756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:52.694611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 494/957] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:52.700701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.775460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a870fd-3412-464b-acad-ed22af8bf9fb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:52.800912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9329c0-a801-4171-84a6-a768f13bd7cc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:52.810827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:52.811759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.812241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.812705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.813667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:52.814842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:52.816513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:52.835724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:52.836485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:52.836772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:52.837051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:52.837758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:52.838108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:52.838552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 464/958] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:52.843297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97a998-8565-497b-8a7d-74d6e75f8807 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:52.851623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 495/959] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:52.859713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:52.971100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab431ef-52e1-46c3-ae4f-8a61c0f12d98 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:53.008496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:53.009563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.010068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.010584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.011529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:53.012059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:53.013674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501f172-472b-43b4-8459-9329df588d5f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:53.020161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 465/960] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:53.088263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0c16-bb8c-4164-9864-6376e014c3ac None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.088602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0c16-bb8c-4164-9864-6376e014c3ac None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.088834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0c16-bb8c-4164-9864-6376e014c3ac None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.090710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 496/961] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:53.097437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255dda-b20b-4e97-807f-619964293476 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.097782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255dda-b20b-4e97-807f-619964293476 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.098008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255dda-b20b-4e97-807f-619964293476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.118926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f0255dda-b20b-4e97-807f-619964293476 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:53.120855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f0255dda-b20b-4e97-807f-619964293476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:53.202531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 466/962] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:53.222571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0c16-bb8c-4164-9864-6376e014c3ac None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.332491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0c16-bb8c-4164-9864-6376e014c3ac None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:53.365820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:53.366934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.367394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.367814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.379725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:43:53.388199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:53.389324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:43:53.390341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:53.397972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 497/963] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:53.403551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255dda-b20b-4e97-807f-619964293476 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.508832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255dda-b20b-4e97-807f-619964293476 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:53.558526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:53.559284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.559571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.559858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.560636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:53.560949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:53.562434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc5b8-d4e3-4601-8a4e-7043fbc62d9e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:53.572948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 467/964] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:53.578750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.687016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fccdf4-152d-435e-8ccb-de4ccaf8b2e8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:53.722916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:53.723706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.723986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.724259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.734517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:53.736007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-97814584-f0a6-4dd7-a5f0-7d4c0f227822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:53.753637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:53.754589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:53.755868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:53.755868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:53.755868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:53.755868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:53.756114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3a2f-3d76-4beb-a453-ee5d838451cd None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.756188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 498/965] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:53.756254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3a2f-3d76-4beb-a453-ee5d838451cd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.756254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3a2f-3d76-4beb-a453-ee5d838451cd None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.757229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 468/966] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:53.762873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe3a2f-3d76-4beb-a453-ee5d838451cd None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.762995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.763236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.763522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.785016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:53.786238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:53.865390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 499/967] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:53.878342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe3a2f-3d76-4beb-a453-ee5d838451cd None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:53.889363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.917824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:53.918814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:53.919295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:53.919665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:53.920456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:53.920835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:53.922267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:53.941287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 469/968] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:53.942800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:53.991954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f0ef-ef79-41e3-a544-c04dce6e6d67 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.026530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.027272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.027557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.027834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.028485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.029855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:54.042440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:54.043461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:54.044984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 500/969] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:54.046064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26fd7f-9e85-41e2-98bd-ddc643b5b67b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.053962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.093642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.094480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.094765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.095040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.104854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.106580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:54.126003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:54.127559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:54.128522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 470/970] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:43:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:54.133361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.166439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0c14-02f7-467a-bb67-41734e27fafc None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.201380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.202532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.203040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.203539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.204443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:54.204995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.206606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.216739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 501/971] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:54.217979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.235020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64616-8465-4785-8097-3ed2f99b6e25 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.269313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.269979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.270270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.270608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.271376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:54.271696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.273089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.296696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 471/972] 10.222.0.57 () {56 vars in 1149 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:54.298092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.325969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca17d-849c-4068-874b-6d7de119529d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.360797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.362354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.362889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.363389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.364314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:54.364872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.366509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.377088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 502/973] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:54.378253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.399446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcb792-b1d5-4982-840f-59e29eea478e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.434140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.434893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.435098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.435373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.481985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f900-7d49-4693-8e08-f5666cf175f1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.505216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.506875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.518051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.519620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.520385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.521111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.522142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] RBAC: Adding query filter params (interface=admin, service_id=cda34479ba0040cba99c25cfbc012a1a, region_id=RegionOne) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:54.522713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.524645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.537728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 503/974] 10.222.0.57 () {56 vars in 1249 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/endpoints?service_id=cda34479ba0040cba99c25cfbc012a1a&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:54.539261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.625626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 472/975] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:43:54.627590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.645060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5302f-88ae-4124-94e1-51ae041cb119 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.679803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.680806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.681286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.681745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.682660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.684340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.698783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 504/976] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:43:54.729597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c40adb-82ee-44f1-9cef-f66d473e02d0 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.768669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.769474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.769751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.770020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.781448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.783671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:43:54.803458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:54.804494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:54.805465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:43:54.805465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:43:54.805465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:43:54.805465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:54.809463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 473/977] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:54.810893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:54.918420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2073e-49c4-46b7-b67c-0fd56d5478d2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:54.952510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:54.953170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:54.953449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:54.953720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:54.954437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:54.954973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:54.956351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:54.971747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 505/978] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:54.974959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.082741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609430a-87b5-4203-be9d-20a9007ef761 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.117401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.118195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.118488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.118772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.126167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.128382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2707a3e6-d9eb-4b68-8598-9b453965c43a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:43:55.142937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:55.143838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:43:55.144734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.149006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 474/979] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:55.150518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.216108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9abf-f721-4eee-bd03-bd915ef62ccf None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.216461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9abf-f721-4eee-bd03-bd915ef62ccf None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.216657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9abf-f721-4eee-bd03-bd915ef62ccf None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.218475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 475/980] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:43:55.224079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.224398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.227454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.248930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:55.251119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:55.259659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a246-95ac-4d93-b943-48f72b305c4f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.293987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.294677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.294966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.295245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.296040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:55.296353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.297795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.310196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 506/981] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:55.317287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.338774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 476/982] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:55.363568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.441174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2390233-023f-42cc-ad4d-83178b4ea3fb None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.467760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bade6e-5f8c-43f8-ad32-9c79763a55c0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.475911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.476570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.476849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.477118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.477942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] RBAC: Adding query filter params (role.id=5a759fff33284cab93447790f0cd1a96, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=d61df7a7c5b24a3482bff127f4d63d49) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:55.478252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.479722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd41028-7172-4a11-949d-530d160afa1a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 507/983] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:43:55 2022] GET /identity/v3/role_assignments?user.id=d61df7a7c5b24a3482bff127f4d63d49&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=5a759fff33284cab93447790f0cd1a96 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52ab3-a97c-406d-b592-342ed9bd2595 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52ab3-a97c-406d-b592-342ed9bd2595 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52ab3-a97c-406d-b592-342ed9bd2595 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 508/984] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:55.494555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.495071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.495071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.511715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.512431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.512714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.512991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.513764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.515008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:55.515360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.516218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:55.535418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.sql.core [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:43:55.535418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 19:43:55.535418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [parameters: {'user_id': '50c5aca664e1429ab6064e2da41f9c54', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 19:43:55.535418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79896) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:43:55.543892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:43:55.544832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application yield resource May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application next(self.gen) May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.rollback() May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.force_reraise() May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise self.value May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application session.commit() May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 19:43:55.545832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._prepare_impl() May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.session.flush() May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._flush(objects) May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application compat.raise_( May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application flush_context.execute() May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rec.execute(self) May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 19:43:55.546763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 19:43:55.547678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result = self._query(query) May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application conn.query(q) May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application result.read() May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 19:43:55.548576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [parameters: {'user_id': '50c5aca664e1429ab6064e2da41f9c54', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:55.549418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 19:43:55.550226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 19:43:55.552859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.555075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 477/985] 10.222.0.57 () {60 vars in 1131 bytes} [Tue May 10 19:43:55 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:55.561784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.623277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 509/986] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:43:55.648411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.688036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26f96-8e3c-42a1-b54d-5fc5fd11fc11 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.730718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.731863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.732173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.732419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.742729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.744647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:43:55.761385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:55.762546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 19:43:55.763647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:55.765626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 478/987] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:43:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:55.769523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5faf4-4805-4738-9556-d382cd968a05 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.772459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:55.817218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.817983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.818555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.818904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.820088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.821974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2df180-8643-4ae0-a2d2-266df150f98b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.839411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 510/988] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:43:55 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:43:55.886497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3efd4d-943c-4590-88dc-4e4a2430850c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:55.940235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:55.940930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:55.941210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:55.941482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:55.942310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:55.942785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:55.944353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73308ef-83c0-44c2-9824-8cb5eae2ea86 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:55.991898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 479/989] 10.222.0.57 () {56 vars in 1101 bytes} [Tue May 10 19:43:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:57.052014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250cfb-6808-41e4-b5d6-f7cacf961821 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.052539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250cfb-6808-41e4-b5d6-f7cacf961821 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.052616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250cfb-6808-41e4-b5d6-f7cacf961821 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.054139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 511/990] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:57.059325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.059731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.059891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.076574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:57.078093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:57.142922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 480/991] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:57.165439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250cfb-6808-41e4-b5d6-f7cacf961821 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:57.262281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250cfb-6808-41e4-b5d6-f7cacf961821 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:57.295460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:57.296267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.296551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.296827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.297481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:57.299455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:57.311344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:57.312343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 19:43:57.313210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:57.314687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 512/992] 10.222.0.57 () {56 vars in 1126 bytes} [Tue May 10 19:43:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:57.318622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:57.414148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4bd3c-ac0c-4f12-9240-5f2790782b8a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:57.446349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:57.447041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.447325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.447601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.448302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:57.448610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:57.449973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:57.458624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 481/993] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:57.461086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:57.565098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7f46d-a2de-4c17-b389-df13c62e4f33 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:57.598174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:57.598865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.599153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.599431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.600145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:57.600452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:57.601823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569a2a4-425a-4cdd-8bff-1f0816d19581 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:57.608232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 513/994] 10.222.0.57 () {56 vars in 1122 bytes} [Tue May 10 19:43:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:57.613481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:57.715582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802e81-bc16-419a-8184-48f64ded6517 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:57.749225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:57.750140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.750426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.750747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.751539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:57.753414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732a3fb-4719-46b7-9281-97577e3a2f8f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:57.770720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 482/995] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:43:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:43:57.830540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6940726-61be-4761-9b4b-5f9d93c4552f None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.830750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6940726-61be-4761-9b4b-5f9d93c4552f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.831024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6940726-61be-4761-9b4b-5f9d93c4552f None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.832670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 514/996] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:57.838407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3511-8b2a-40a6-9c3b-32247e57d393 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:57.838740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3511-8b2a-40a6-9c3b-32247e57d393 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:57.839007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c3511-8b2a-40a6-9c3b-32247e57d393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:57.857000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-500c3511-8b2a-40a6-9c3b-32247e57d393 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:57.858213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-500c3511-8b2a-40a6-9c3b-32247e57d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:57.938085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 483/997] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:57.961058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6940726-61be-4761-9b4b-5f9d93c4552f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.064943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6940726-61be-4761-9b4b-5f9d93c4552f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.098518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.099290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.099577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.099857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] PATH_INFO: `/v3/services/image` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.100562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.102055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.112098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada766-3053-4256-a1c2-3105052dada5 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.112569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada766-3053-4256-a1c2-3105052dada5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.112673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada766-3053-4256-a1c2-3105052dada5 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.114020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 484/998] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:58.114263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:58.115275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:43:58.116127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 515/999] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 19:43:57 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:43:58.122814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.123108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.123392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.123668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.140776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:43:58.141963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:43:58.218507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 485/1000] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:43:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:43:58.222441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab69cc-50bb-4d3b-a781-9f9edae2e514 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.239457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.256967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.257901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.258376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.258720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.259434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] RBAC: Adding query filter params (name=image) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:58.259749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.261129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.266090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 516/1001] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:58.272030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.344342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdd155-30c6-4041-84e7-7dc8b13657dc None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.377868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768666-16c0-4812-bd07-65511d474dbd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.378874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.379670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.379959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.380234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.380894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.382292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:43:58.394354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:43:58.395382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:43:58.396329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 486/1002] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:43:58.401544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.415541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.416204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.416539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.416820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.417525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] RBAC: Adding query filter params (type=image) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:58.417830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.419226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.424363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 517/1003] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:58.507743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627cfb-2d68-4f61-bbf3-e100d61fe813 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.547611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.548291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.548574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.548854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.549573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:58.549885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.551323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.557052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 487/1004] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:58.562679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.669615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a6817-0862-4dfa-a993-7e6b653d3364 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.701861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.702546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.702833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.703105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.703811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:58.704114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.706052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.715912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 518/1005] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:43:58.717506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.813436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dcf33-78d9-4ef5-a680-4d01908dcc17 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.844968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.846150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.846432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.846731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.847577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] RBAC: Adding query filter params (interface=public, service_id=8dcc6922c58043dcb1db840a0f8ade53, region_id=RegionOne) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:43:58.847904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.849253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ef53-a59b-4fa7-a4c0-1fc745ca91fa None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:58.854274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 488/1006] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/endpoints?service_id=8dcc6922c58043dcb1db840a0f8ade53&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:43:58.859732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:43:58.959706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342d58-89e5-4a33-99be-d1e0149da016 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:43:58.992263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:43:58.992922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:43:58.993298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:43:58.993472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:43:58.994149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:43:58.995592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d7ea8-4dbd-4ac4-b729-f25e1f556a01 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:43:59.002290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 519/1007] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:43:58 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:44:00.052229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06baf-7341-4abd-9557-ae4e788cbdd8 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.052773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06baf-7341-4abd-9557-ae4e788cbdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.052773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06baf-7341-4abd-9557-ae4e788cbdd8 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.054326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 489/1008] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:00.059576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.060029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.060119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.077041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:00.078203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:00.144908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 520/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:00.167431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b06baf-7341-4abd-9557-ae4e788cbdd8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:00.264392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b06baf-7341-4abd-9557-ae4e788cbdd8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:00.299751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:00.300539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.300818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.301091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.302296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:00.303699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db2e83-b650-4bd2-ae91-c3f2506ddeec None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:00.310041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 490/1010] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:00.311276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:00.406147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff35496-4f61-4977-8950-08683cb73cfb None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:00.438758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:00.440025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.440311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.440587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.441287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:00.442764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3888ca0-60ed-417f-a246-e492247dfdcb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:00.470712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 521/1011] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:44:00 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:00.683298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0984ab-7564-4d80-8d0f-7956a23e85c7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.683515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0984ab-7564-4d80-8d0f-7956a23e85c7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.683804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0984ab-7564-4d80-8d0f-7956a23e85c7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.685314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 491/1012] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:00.690647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182466a-8855-41d6-8c8f-0a02139d479a None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.690943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182466a-8855-41d6-8c8f-0a02139d479a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.691211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182466a-8855-41d6-8c8f-0a02139d479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.708586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7182466a-8855-41d6-8c8f-0a02139d479a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:00.709780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7182466a-8855-41d6-8c8f-0a02139d479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:00.782505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 522/1013] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:00.802002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0984ab-7564-4d80-8d0f-7956a23e85c7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:00.901651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0984ab-7564-4d80-8d0f-7956a23e85c7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:00.936455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:00.937428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:00.937892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:00.938341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:00.939290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:00.940838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e63cc7-d88f-40e7-86f0-6165917a72ec None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:00.956095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 492/1014] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:44:00 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:01.242873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e4e1-56b1-4676-ab86-5e57a0d4323a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.243415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e4e1-56b1-4676-ab86-5e57a0d4323a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.243415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e4e1-56b1-4676-ab86-5e57a0d4323a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.244934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 523/1015] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:01.250160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.250579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.250747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.267793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:01.268942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:01.340247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 493/1016] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:01 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:01.362866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604e4e1-56b1-4676-ab86-5e57a0d4323a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:01.459997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604e4e1-56b1-4676-ab86-5e57a0d4323a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:01.494298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:01.495043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.495327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.495602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.496252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:01.497626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:01.509456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:01.510435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 19:44:01.511352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:01.514779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 524/1017] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:44:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:01.516642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:01.612468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb178e-8de3-4323-b1fb-39f12dba3490 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:01.645167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:01.645856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.646139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.646415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.647172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:01.647485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:01.648898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:01.654549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 494/1018] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:44:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:01.660470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:01.759042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846519e9-6862-4d0f-ae02-49f83e265763 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:01.791860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:01.792529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.792814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.793094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.793798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:01.794108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:01.795595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951ba9a-d53f-44ac-8b68-e89169ca0887 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:01.806867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 525/1019] 10.222.0.57 () {56 vars in 1112 bytes} [Tue May 10 19:44:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:01.807055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:01.901869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad586-9646-4079-82aa-6e61ca03dc32 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:01.933776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:01.934424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:01.934735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:01.935016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:01.935746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:01.937099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d7a6a-a504-4266-b10f-45c14d90ea77 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:01.955642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 495/1020] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:44:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:02.763362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fafb75-00b1-4d47-b9b0-b6d8ff800d48 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:02.763871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fafb75-00b1-4d47-b9b0-b6d8ff800d48 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:02.763948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fafb75-00b1-4d47-b9b0-b6d8ff800d48 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:02.765321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 526/1021] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:02.771030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:02.771436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:02.771628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:02.788406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:02.789539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:02.865315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 496/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:02.890082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fafb75-00b1-4d47-b9b0-b6d8ff800d48 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:02.991005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fafb75-00b1-4d47-b9b0-b6d8ff800d48 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.023056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.023843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.024129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.024407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.025584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.027059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb276c-1c54-4d7f-bf57-8d837465e494 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.034244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 527/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:03.036050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:03.136536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953251f-e989-4dc9-9ad1-166a2c539e64 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.169700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.170395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.170733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.171016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.171768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.173818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111443a6-29e9-4aec-8d7e-817db8166c0b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.198499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 497/1024] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:44:03 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:03.230707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160a28-e931-4e74-af5a-52aaa7b4cfb9 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.231005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160a28-e931-4e74-af5a-52aaa7b4cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.231291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db160a28-e931-4e74-af5a-52aaa7b4cfb9 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.232878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 528/1025] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:03.239150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.239462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.239722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.258169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:03.259435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:03.332994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 498/1026] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:03.357277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db160a28-e931-4e74-af5a-52aaa7b4cfb9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:03.460044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db160a28-e931-4e74-af5a-52aaa7b4cfb9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.492814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.493615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.493899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.494175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.494857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.496230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:03.508442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:03.509398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:03.510326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 529/1027] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 19:44:03 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:03.515884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:03.615861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698b04-e769-485a-aaf8-cce1d7d790ea None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.650545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269952c-5858-477b-8d08-221123b67474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.651208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269952c-5858-477b-8d08-221123b67474 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.651491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269952c-5858-477b-8d08-221123b67474 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.651764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269952c-5858-477b-8d08-221123b67474 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.652470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269952c-5858-477b-8d08-221123b67474 None admin] RBAC: Adding query filter params (name=image) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:03.652771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269952c-5858-477b-8d08-221123b67474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.654127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269952c-5858-477b-8d08-221123b67474 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.659557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 499/1028] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:03.665677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:03.766162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff16a1-46f9-46d2-b140-388bb4f035d2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.800314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.800980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.801264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.801537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.802247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] RBAC: Adding query filter params (type=image) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:03.802578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.803956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.808936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 530/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:03.815662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269952c-5858-477b-8d08-221123b67474 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:03.919497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269952c-5858-477b-8d08-221123b67474 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:03.952253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:03.952908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:03.953194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:03.953467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:03.954276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] RBAC: Adding query filter params (interface=public, service_id=c8aa7b9bc6564ff79e1ca43b5c7a3d17, region_id=RegionOne) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:03.955728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:03.957573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cbd43-e1ec-473b-ac44-4ca5f9981c3b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:03.967371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 500/1030] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:44:03 2022] GET /identity/v3/endpoints?service_id=c8aa7b9bc6564ff79e1ca43b5c7a3d17&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:03.968875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:04.070779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538028a7-da07-474b-b917-3bfe2c083426 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:04.102989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:04.103656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.103940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.104218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.104896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:04.106269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ac26d-b99f-4146-a419-10f5c5240e7f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:04.118493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 531/1031] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:44:03 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:44:04.315313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78699b-a1df-4930-8557-0e17d7fbb241 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.315604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78699b-a1df-4930-8557-0e17d7fbb241 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.315880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78699b-a1df-4930-8557-0e17d7fbb241 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.317261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 501/1032] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:04.324560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.324560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.324560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.339787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:04.340978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:04.405785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 532/1033] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:04.429643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78699b-a1df-4930-8557-0e17d7fbb241 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:04.529072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78699b-a1df-4930-8557-0e17d7fbb241 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:04.562064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:04.562899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.563182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.563454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.574109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:04.583129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:04.584114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:04.584962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:04.586590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 502/1034] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:44:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:04.590314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:04.688417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310105c-3dd6-451b-8b97-85e237b0717d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:04.722197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:04.723095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.723556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.723979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.724872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:04.725321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:04.726848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:04.734610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 533/1035] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:44:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:04.740329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:04.835585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7577-586f-4095-88b6-c9232744c057 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:04.867967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:04.868764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:04.869046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:04.869319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:04.879984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:04.881415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:04.898385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:04.899430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:04.906814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:04.906814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:04.906814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:04.906814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:04.906814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 503/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:04.907149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.008286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe523-e433-4a69-9165-d0f1c4ca0414 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.040882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.041544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.041827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.042102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.042848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:05.043155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.044522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.061527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 534/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:05.062683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.158124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fff96-e056-49de-be82-c6e56e8c6ebb None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.190989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.191776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.192059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.192334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.199864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.201291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:44:05.214823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:05.215764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:05.221879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 504/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:05.222536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.320009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59d33d-8818-484f-9fef-b0dba7c52e5c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.361030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.361727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.362004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.362271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.363303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:05.363610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.366009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac34aa-750c-41cc-9bbd-658dbdf5f276 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.390709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 535/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:05.392028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.489239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0062-8ec5-44c8-8c5b-45d502776762 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.527182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.527840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.528120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.528393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.537086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee267c3-609f-4ad4-9be8-503a1536caff None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.537383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee267c3-609f-4ad4-9be8-503a1536caff None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.537938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee267c3-609f-4ad4-9be8-503a1536caff None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.539217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 536/1040] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:44:05.543851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.544386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.544386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.564358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:05.565776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:05.593969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.595983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.638325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 537/1041] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:44:05.661421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.698604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 505/1042] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:05.704021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.766145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8cf28-c049-410c-a9d6-616004815d04 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.799187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.799535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059aae-2aa9-49cd-b26f-c198fb0742bd None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.799974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.800256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.800526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.810776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:05.818871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:05.819860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:05.820709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 538/1043] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:05.825831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.836710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.837513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.837799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.838078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.848067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.849501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:05.867390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:05.868351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:05.869255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:05.869255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:05.869255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:05.869255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:05.869255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 506/1044] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:05.874081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:05.928871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08917-5890-4e3d-9631-4e2a45c6e754 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.961631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:05.962298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:05.962619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:05.962901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:05.963648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:05.963954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:05.965320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:05.971917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3ce7c-b48c-414f-a874-75e544efab1d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:05.974487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 539/1045] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:05.979672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.009080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.009748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.010030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.010307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.011058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:06.011369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.012770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.025108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 507/1046] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:06.030831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.085963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243b06-039c-47f2-96c5-07b39899996c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.117730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.118617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.118901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.119167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] PATH_INFO: `/v3/users/7e151de917d44d8bb64e3f64695beb8e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.131246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca2030-ff45-4efb-b1a8-8627fcbd794f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.132818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] RBAC: Authorizing `identity:get_user(user_id=7e151de917d44d8bb64e3f64695beb8e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.134279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.140606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 540/1047] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:05 2022] GET /identity/v3/users/7e151de917d44d8bb64e3f64695beb8e => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:06.141473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.165624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.166407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.166786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.167062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.175194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.176730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:44:06.192385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:06.193390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:06.194292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 508/1048] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:06.199681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.242630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d296d-c159-4b16-abdd-59bb48673c1a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.275891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.276471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.276759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.277041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.297856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a549b2e-e193-4e6c-978b-43df4be990a6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.335974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.336633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.336909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.337178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.337952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:06.338257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.339711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.343135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.344581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320233d-9727-4e41-a682-2278c9b69bb7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.351735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 509/1049] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:06.357561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.440320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 541/1050] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:06.441930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c711-8d79-4358-b028-7ce700efb46c None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.442219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c711-8d79-4358-b028-7ce700efb46c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.442522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c711-8d79-4358-b028-7ce700efb46c None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.443914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 542/1051] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:06.446181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1c711-8d79-4358-b028-7ce700efb46c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.453144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409503-cb75-4791-badf-9c63fee585a9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.484457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.485105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.485926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.486201 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.487070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] RBAC: Adding query filter params (role.id=5a759fff33284cab93447790f0cd1a96, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:06.487379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.488790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b85697-af21-4f2c-9f82-2531e455acc3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.502030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 510/1052] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=5a759fff33284cab93447790f0cd1a96 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:06.502030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.502030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.502030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.513698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:06.514962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:06.560586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1c711-8d79-4358-b028-7ce700efb46c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.588347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 511/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:06.596634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.597505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.597793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.598070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.599317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.600779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.606494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 543/1054] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:06.608643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.612024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.711561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec1b5-c95e-430a-88bc-684267171dcd None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.720466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557b04-fcc0-4a07-8d6b-54dd5d82643f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.744873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.745522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.745800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.746069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.746934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=a5385327856d418488939a01744f6efc, user.id=7e151de917d44d8bb64e3f64695beb8e) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:06.747358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.748651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.762811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 512/1055] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/role_assignments?user.id=7e151de917d44d8bb64e3f64695beb8e&scope.project.id=a5385327856d418488939a01744f6efc&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:06.763678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.764544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.764834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.765113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.765787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.767846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:06.780384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:06.781536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:06.783097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 544/1056] 10.222.0.57 () {56 vars in 1105 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:06.788706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:06.891408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274de64-082e-4a5d-92a1-57cc0569eb3b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:06.926372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:06.927069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:06.927352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:06.927625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:06.928338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] RBAC: Adding query filter params (name=image) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:06.928643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:06.930008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:06.940382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 513/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:06.941602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:07.040451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476ef31-2af9-447b-aa3e-4cd0bbcb96e6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:07.074525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:07.075195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:07.075482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:07.075761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:07.076468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] RBAC: Adding query filter params (type=image) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:07.076775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:07.078146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9f7ff-c541-48e1-8115-8a7dbcea07de None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:07.087673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 545/1058] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:07.088703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:07.185931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af0e30-9dce-4c8f-9560-8ae16c3bf46d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:07.218785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:07.219443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:07.219776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:07.220054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:07.220799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:07.222201 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472103f7-91ee-4a42-a525-190471676b4c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:07.242116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 514/1059] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:44:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:08.703346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038203f-1fe2-4231-acbd-10c0499aa9e3 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:08.703856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038203f-1fe2-4231-acbd-10c0499aa9e3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:08.703932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038203f-1fe2-4231-acbd-10c0499aa9e3 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:08.705432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 546/1060] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:08.710488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b3c-ae62-4188-a590-78ddda17ed97 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:08.710903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b3c-ae62-4188-a590-78ddda17ed97 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:08.711042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12b3c-ae62-4188-a590-78ddda17ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:08.727976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c6a12b3c-ae62-4188-a590-78ddda17ed97 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:08.729138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c6a12b3c-ae62-4188-a590-78ddda17ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:08.803780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 515/1061] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:08.826433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038203f-1fe2-4231-acbd-10c0499aa9e3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:08.924383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038203f-1fe2-4231-acbd-10c0499aa9e3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:08.956529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:08.957332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:08.957614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:08.957885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:08.968215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:08.974060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cd9d-d5cc-4044-895e-956cbb731016 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:08.974355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cd9d-d5cc-4044-895e-956cbb731016 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:08.974679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70cd9d-d5cc-4044-895e-956cbb731016 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:08.976202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 516/1062] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:08.976305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:08.977266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:08.978116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:08.980857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:08.981151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:08.981434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:08.982325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 547/1063] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:44:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:08.983053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:08.998729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:09.000169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:09.070674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 517/1064] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:44:09.085656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873aa71-a32b-4ed4-949c-91388be6d2a6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.092751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.124489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.125422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.125703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.126576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.127326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:09.127631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.129020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.142110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 548/1065] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:44:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:09.143259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.206386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a17d7-972d-448e-9bc9-5afe1dd7a384 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.240274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.241060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.241338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.241611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.245360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01be7-8332-4d2a-bb81-7a8b25cdcaf4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.251681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:09.259081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:09.260011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:09.260857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 518/1066] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:09.265973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.280750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.281545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.281832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.282658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.292949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.294389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:09.311567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:09.312557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:09.314134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:09.314134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:09.314134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:09.314134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:09.314134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 549/1067] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:09.319367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.369555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55938dba-7129-4e6d-b988-9fc2eba529ed None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.404340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.405006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.405286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.405566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.406313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:09.406660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.408027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.416129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 519/1068] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:09.421834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.429011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933501-94ef-4693-ad22-92f95b7128a8 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.463635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.464310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.464587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.464862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.465588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:09.465895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.467288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.483795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 550/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:09.484834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.529119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d06fb-495f-443b-a3bf-ba0ec494e67b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.562252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.563141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.563989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.564274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] PATH_INFO: `/v3/users/7e151de917d44d8bb64e3f64695beb8e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.565468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] RBAC: Authorizing `identity:get_user(user_id=7e151de917d44d8bb64e3f64695beb8e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.566927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa8bac-6b3f-4588-9ff3-2f702bcce047 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.568559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 520/1070] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/users/7e151de917d44d8bb64e3f64695beb8e => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:09.569741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a514-6bc5-47d3-8cd2-fbb7a0a03da6 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.570026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a514-6bc5-47d3-8cd2-fbb7a0a03da6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.570307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a514-6bc5-47d3-8cd2-fbb7a0a03da6 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.574493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 521/1071] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:09.574493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a514-6bc5-47d3-8cd2-fbb7a0a03da6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.581632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f8ec5-14ab-4a1e-841d-fd0ff5f9d453 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.613720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.614517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.614804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.615081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] PATH_INFO: `/v3/users/nova` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.622346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.623763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-541b9528-9212-4171-8325-0ffa8c30cded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:44:09.637927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:09.638983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 551/1072] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.645268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.646039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.656214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:09.657433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:09.670340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a514-6bc5-47d3-8cd2-fbb7a0a03da6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.702480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.703351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.703637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.703943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.705118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.706571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.708269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 522/1073] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:09.709020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.720296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 552/1074] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:09.720972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.805711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08493-0803-4c3a-8b1a-58617ab422cc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.815636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c29264-bb7f-4162-8fe4-605794bf6361 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.838103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.838808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.839091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.839373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.840200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:09.840511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.841929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.847092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:09.847962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:09.848253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:09.848518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc/users/7e151de917d44d8bb64e3f64695beb8e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:09.850556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a5385327856d418488939a01744f6efc, user_id=7e151de917d44d8bb64e3f64695beb8e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:09.851973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:09.859230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 523/1075] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:09.860138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.866668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 553/1076] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:44:09 2022] PUT /identity/v3/projects/a5385327856d418488939a01744f6efc/users/7e151de917d44d8bb64e3f64695beb8e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:44:09.867482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:09.965347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ff10-871b-4c7d-af35-8682b394448d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:09.972492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bf54-2c0c-4a66-8721-9561eb6fd9aa None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.002597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.003268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.003550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.003826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.009086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.009883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.010163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.010438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.022627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.024116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:10.044083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:10.045048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:10.045946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:10.045946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:10.045946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:10.045946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:10.048652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 554/1077] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:10.053422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.074969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.076420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.153021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bea95-15ac-451d-96ec-320dbff9c30a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.173263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 524/1078] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:10.179051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.186256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.186949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.187227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.187498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.188241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:10.188782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.190126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.201866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 555/1079] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:10.207781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.277952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0742d-cbda-4122-b6be-eedcebb504b5 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.302654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd35008-0528-4905-ac32-c3ed0dc38832 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.310977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.311770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.312054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.312331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.322313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.323810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.335989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.336913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.337297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.337671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:10.343141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:10.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:10.345209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:10.345209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:10.345209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:10.345209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:10.345209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 525/1080] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:10.346700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.348137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.350535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:44:10.363381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:10.364484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:10.365604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:10.367415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 556/1081] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:10.372709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.453341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b317276-4de8-4530-9688-c6c661f902c6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.471655 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1987-c03f-4acb-a57b-125765351347 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.488572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.489229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.489510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.489782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.490525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:10.490831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.492190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.510592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 526/1082] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:10.510795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.510795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.510795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.510795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.511133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:10.511133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.511133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f4ca5-ce67-4c79-b85f-794fb316b287 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.525713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 557/1083] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:10.530961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:10.634253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233709-1888-449a-888d-e02c9ee8b31b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:10.669210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:10.670118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:10.670397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:10.670697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/5a759fff33284cab93447790f0cd1a96` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:10.673554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=fdcb012cc78d44a2afb7762daa15517c, role_id=5a759fff33284cab93447790f0cd1a96)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:10.675039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616ad9d-cb54-40c6-8c75-2272c9e3abf3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:10.690680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 527/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:44:10 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/fdcb012cc78d44a2afb7762daa15517c/roles/5a759fff33284cab93447790f0cd1a96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:44:12.116286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa17b-5871-4f3f-b825-2a3641e967be None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.116814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa17b-5871-4f3f-b825-2a3641e967be None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.116900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa17b-5871-4f3f-b825-2a3641e967be None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.118217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 558/1085] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:12.123820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.124222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.124368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.141307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:12.143073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:12.206193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 528/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:12.228600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa17b-5871-4f3f-b825-2a3641e967be None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:12.325292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa17b-5871-4f3f-b825-2a3641e967be None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:12.357153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:12.357932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.358212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.358505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.369213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:12.376921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:12.377879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:12.378985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 559/1087] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:12.383982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:12.477727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744f992-aa71-42cd-9a53-c63e3f7b9c19 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:12.512439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:12.513102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.513383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.513657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.514397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:12.514730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:12.516092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:12.528393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 529/1088] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:12.534680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:12.630859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ac55-dbec-4453-950a-cce2d9c44b9f None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:12.662306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:12.663195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.663484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.663763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] PATH_INFO: `/v3/users/7e151de917d44d8bb64e3f64695beb8e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.664943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7e151de917d44d8bb64e3f64695beb8e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:12.666381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ce083-48d7-4ceb-851f-c28dd39982f8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:12.668057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 560/1089] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:12 2022] GET /identity/v3/users/7e151de917d44d8bb64e3f64695beb8e => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:12.674183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:12.777247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d83b5d-32b0-43e0-ab39-666ce6b5024c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:12.809579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:12.810221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.810533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.810816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.873414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:12.875164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:12.896947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540af5-0869-4670-986a-8dc614ac8945 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.897170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540af5-0869-4670-986a-8dc614ac8945 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.897452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26540af5-0869-4670-986a-8dc614ac8945 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.898849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 561/1090] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:44:12.903666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:12.903955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:12.904235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:12.920648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:12.921825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:12.969307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 530/1091] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:44:12.975607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:12.987565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 562/1092] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:44:13.010682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.071343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cac65-c4c8-4364-8a90-e4b46a426a19 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.104122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.104335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e106-8d15-4698-b234-da2dbd7b53ed None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.104960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.105239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.105512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.106707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.108129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.109819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 531/1093] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:12 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:13.116321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.137621 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.138424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.138734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.139007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.149047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:13.157022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:13.157941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:13.158834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 563/1094] 10.222.0.57 () {56 vars in 1120 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:13.164260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.209088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda01c5c-bec1-4985-b524-0d6b32fbf65c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.240603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.241235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.241512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.241784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.242624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=a5385327856d418488939a01744f6efc, user.id=7e151de917d44d8bb64e3f64695beb8e) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:13.242933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.244332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.250372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 532/1095] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/role_assignments?user.id=7e151de917d44d8bb64e3f64695beb8e&scope.project.id=a5385327856d418488939a01744f6efc&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:13.257907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418b13-8aea-4262-9dcc-179855966ebe None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.293776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.294480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.294768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.295043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.295857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:13.296167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.298119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.307320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 564/1096] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:13.313068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.415045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0326f-06a4-49fe-8873-51fa549f9431 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.449758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.450634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.450918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.451194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.461221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.462694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:13.479705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:13.480676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:13.481656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:13.481656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:13.481656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:13.481656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:13.481656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 533/1097] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:13.487276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.586916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310310a-92c6-4f92-a419-9fc0984cd570 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.619084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.619767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.620051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.620329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.621044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:13.621352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.622749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.634927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 565/1098] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:13.640434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.734086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85be0e-5729-42f7-a753-2de10f6e8820 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.766504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.767298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.767579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.767855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.774732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.776155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:44:13.790711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:13.791866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:13.792828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 534/1099] 10.222.0.57 () {56 vars in 1093 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:13.797560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:13.892477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0c524-f906-4cb8-bc7b-166e5f4a25df None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:13.924640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:13.925296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:13.925587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:13.925864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:13.926725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:13.927034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:13.928459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:13.945370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 566/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:13.951048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.046483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ca89-a48a-42e1-a168-c9fdcece623b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.081110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.081759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.082043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.082321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.147436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:14.148878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:14.240099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 535/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:44:14.245794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.343138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f882-a7ac-43b5-ad74-185f59a9bb80 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.375336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.376688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.376967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.377236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.387168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:14.388653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:14.407404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:14.408481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:14.409390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:44:14.409390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:14.409390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:44:14.409390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:14.409390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 567/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:44:14.414276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.507648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10386954-1afe-4914-bb36-30fad36b0a2d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.540189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.540851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.541130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.541402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.542112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:14.542414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:14.543790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:14.555152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 536/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:14.560660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.655776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688331f5-f178-416c-8faf-a14fe1f58b2b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.687682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.688987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.689269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.689546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.695967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:14.697407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:44:14.710683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:14.711657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:14.712554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 568/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:14.717598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.817600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03708574-2160-41c1-ab07-a294a3e0033d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.848828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.849474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.849758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.850035 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.850860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:14.851170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:14.852582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047ea3-938a-44f0-aca8-11787324bbec None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:14.864634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 537/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:14.870587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:14.965266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aafa5-ccbc-4697-bd64-d023cbe545cd None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:14.997051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:14.997707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:14.997996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:14.998274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:14.999133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] RBAC: Adding query filter params (role.id=5a759fff33284cab93447790f0cd1a96, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=fdcb012cc78d44a2afb7762daa15517c) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:14.999702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:15.001691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e489d3-f61e-4b74-8cec-f57799453c0a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:15.007611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 569/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:14 2022] GET /identity/v3/role_assignments?user.id=fdcb012cc78d44a2afb7762daa15517c&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=5a759fff33284cab93447790f0cd1a96 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:15.511687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840677-7cfe-4a4f-a4c0-bfa6b3ea6865 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:15.512300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840677-7cfe-4a4f-a4c0-bfa6b3ea6865 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:15.512300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840677-7cfe-4a4f-a4c0-bfa6b3ea6865 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:15.513582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 538/1107] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:15.519817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:15.520278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:15.520370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:15.540061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:15.541251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:15.607894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 570/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:15.632551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60840677-7cfe-4a4f-a4c0-bfa6b3ea6865 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:15.734372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60840677-7cfe-4a4f-a4c0-bfa6b3ea6865 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:15.768973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:15.769685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:15.769962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:15.770329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:15.771412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:15.772822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4c74-ddce-47a3-9aca-6fc4761e98f2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:15.774438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 539/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:15.780188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:15.876858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc58e4-a1c1-48ec-968f-b8b3fcd37a17 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:15.909287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:15.909952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:15.910236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:15.910539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:15.911245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:15.912683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8054f-dea8-4bf9-9a0b-2bd28ee18176 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:15.931741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 571/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:44:15 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:18.154574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810c05-f89a-48e2-94b4-894428be29b8 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.155126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810c05-f89a-48e2-94b4-894428be29b8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.155126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38810c05-f89a-48e2-94b4-894428be29b8 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.156486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 540/1111] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:18.161764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.162147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.162320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.178475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:18.179647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:18.241837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 572/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:18.264920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38810c05-f89a-48e2-94b4-894428be29b8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:18.361909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38810c05-f89a-48e2-94b4-894428be29b8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:18.394081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:18.394943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.395227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.395501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] PATH_INFO: `/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.396959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] RBAC: Authorizing `identity:get_role(role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:18.398318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:18.399699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 541/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:18 2022] GET /identity/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:18.405578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:18.504248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb0fd6-547e-4423-b8d2-1eaa9dda7190 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:18.535974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:18.536827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.537106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.537373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] PATH_INFO: `/v3/users/7eec4f5128094e2eb149cf1d944e5810` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.550714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] RBAC: Authorizing `identity:get_user(user_id=7eec4f5128094e2eb149cf1d944e5810)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:18.552147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:18.553776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 573/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:18 2022] GET /identity/v3/users/7eec4f5128094e2eb149cf1d944e5810 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:18.559537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:18.653772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e362c-e2d8-4735-9efc-b0df6c627d08 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:18.685602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:18.686177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.686487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.686763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.749039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:18.750788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:18.851963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 542/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:18.857786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:18.950210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc3a3-dd8e-43f7-bbf0-cd62a73d0745 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:18.981637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:18.982488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:18.982824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:18.983093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:18.984235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:18.986332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cef09-4963-4159-b1c0-e2c0068ccba4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:18.988010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 574/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:18 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:18.993848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:19.088863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c953fb-c3ad-4d4f-a289-cdf5b2d92fe9 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:19.126954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:19.127601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:19.127884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:19.128164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:19.128993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=a5385327856d418488939a01744f6efc, user.id=7eec4f5128094e2eb149cf1d944e5810) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:19.129306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:19.130758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25b327-1a99-452f-8ba3-6656767807d2 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:19.136101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 543/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:18 2022] GET /identity/v3/role_assignments?user.id=7eec4f5128094e2eb149cf1d944e5810&scope.project.id=a5385327856d418488939a01744f6efc&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:21.301708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2782-7cc1-4cd3-b645-5285c12c1f29 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.302271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2782-7cc1-4cd3-b645-5285c12c1f29 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.302271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2782-7cc1-4cd3-b645-5285c12c1f29 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.303627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 575/1118] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:21.308795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.309187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.309378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.326008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:21.327219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:21.388624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 544/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:21.411185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d2782-7cc1-4cd3-b645-5285c12c1f29 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:21.506028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d2782-7cc1-4cd3-b645-5285c12c1f29 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:21.537782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:21.538649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.538929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.539198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] PATH_INFO: `/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.540638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] RBAC: Authorizing `identity:get_role(role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:21.541992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:21.543383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 576/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:21 2022] GET /identity/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:21.549543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:21.642865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0d89-04de-4f1d-a573-5b1624e8ef7f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:21.675093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:21.675946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.676228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.676506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] PATH_INFO: `/v3/users/7eec4f5128094e2eb149cf1d944e5810` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.677678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] RBAC: Authorizing `identity:get_user(user_id=7eec4f5128094e2eb149cf1d944e5810)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:21.679146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:21.680785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 545/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:21 2022] GET /identity/v3/users/7eec4f5128094e2eb149cf1d944e5810 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:21.686396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:21.780006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b89a26-a88c-4881-888a-a67b57e679a0 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:21.812301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:21.813163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.813447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.813724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.814920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:21.816347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e055e-3ab3-479d-ada4-33c685962e72 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:21.818006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 577/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:21 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:21.823635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:21.916151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa2fa-ec03-407b-a0d2-808983eeb472 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:21.948163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:21.949018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:21.949295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:21.949565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc/users/7eec4f5128094e2eb149cf1d944e5810/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:21.951735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5385327856d418488939a01744f6efc, user_id=7eec4f5128094e2eb149cf1d944e5810, role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:21.953125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcb472-ec2a-4bbc-922c-e03ec3c79db6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:21.965150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 546/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:44:21 2022] PUT /identity/v3/projects/a5385327856d418488939a01744f6efc/users/7eec4f5128094e2eb149cf1d944e5810/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:44:24.149780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64992-e20a-4604-82e1-56162b3bcfff None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.150347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64992-e20a-4604-82e1-56162b3bcfff None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.150347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed64992-e20a-4604-82e1-56162b3bcfff None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.151703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 578/1124] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:24.157397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.157814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.157952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.174214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:24.175430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:24.242783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 547/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:24.265746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64992-e20a-4604-82e1-56162b3bcfff None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:24.361973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed64992-e20a-4604-82e1-56162b3bcfff None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:24.393917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:24.394779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.395069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.395354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] PATH_INFO: `/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.396815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] RBAC: Authorizing `identity:get_role(role_id=c4264f0ca7394ae2a4263b04069c9f9c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:24.398181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:24.399548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 579/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:24 2022] GET /identity/v3/roles/c4264f0ca7394ae2a4263b04069c9f9c => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:24.405078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:24.497098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fae0d-c5f4-4515-86c9-4e32545826ce None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:24.529100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:24.529957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.530234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.530531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] PATH_INFO: `/v3/users/7eec4f5128094e2eb149cf1d944e5810` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.531851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] RBAC: Authorizing `identity:get_user(user_id=7eec4f5128094e2eb149cf1d944e5810)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:24.533289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:24.534943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 548/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:24 2022] GET /identity/v3/users/7eec4f5128094e2eb149cf1d944e5810 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:24.540438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:24.637228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bbb08-462e-48f1-af5f-9be57e4c8744 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:24.669292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:24.669868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.670154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.670538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.732852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:24.734822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:24.828168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 580/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:24.834705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:24.928299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a4d51-364f-4caa-89b3-bd437064974c None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:24.960163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:24.960996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:24.961277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:24.961550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] PATH_INFO: `/v3/projects/a5385327856d418488939a01744f6efc` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:24.962737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] RBAC: Authorizing `identity:get_project(project_id=a5385327856d418488939a01744f6efc)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:24.964147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a180f2e-716a-4ef7-85c2-3d2024ae65ca None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:24.965807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 549/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:24 2022] GET /identity/v3/projects/a5385327856d418488939a01744f6efc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:24.972275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:25.064663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc728-07c7-41fd-a1b3-f7b7beae7894 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:25.096324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:25.096960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:25.097245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:25.097524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:25.098340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] RBAC: Adding query filter params (role.id=c4264f0ca7394ae2a4263b04069c9f9c, scope.project.id=a5385327856d418488939a01744f6efc, user.id=7eec4f5128094e2eb149cf1d944e5810) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:25.098680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:25.100102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690d64-29d8-4da3-8a4c-3e3fbd844346 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:25.105658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 581/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:24 2022] GET /identity/v3/role_assignments?user.id=7eec4f5128094e2eb149cf1d944e5810&scope.project.id=a5385327856d418488939a01744f6efc&role.id=c4264f0ca7394ae2a4263b04069c9f9c => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:27.311725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37095-62c3-4b90-bcb3-393e156d26bb None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:27.312250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37095-62c3-4b90-bcb3-393e156d26bb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:27.312396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc37095-62c3-4b90-bcb3-393e156d26bb None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:27.313655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 550/1131] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:27.318821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:27.319227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:27.319379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:27.335507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:27.336672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:27.399454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 582/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:27.422397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc37095-62c3-4b90-bcb3-393e156d26bb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:27.517535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc37095-62c3-4b90-bcb3-393e156d26bb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:27.549680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:27.550496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:27.550769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:27.551047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:27.552266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:27.553687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3e679-1eab-48d3-8eed-9d88621f9268 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:27.555347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 551/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:27.561176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:27.653937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492e76-9d73-49fa-9a18-39528d74f685 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:27.685549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:27.686190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:27.686492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:27.686775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:27.688021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:27.689444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce8718-de92-420f-a5c7-31ae68bb6269 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:27.713054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 583/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:44:27 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:29.922377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935179-d036-466a-9678-a6e94bf95d11 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:29.922931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935179-d036-466a-9678-a6e94bf95d11 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:29.922931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935179-d036-466a-9678-a6e94bf95d11 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:29.924234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 552/1135] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:29.929397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:29.929813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:29.929960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:29.946919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:29.948101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:30.011719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 584/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:30.036501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf935179-d036-466a-9678-a6e94bf95d11 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:30.132269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf935179-d036-466a-9678-a6e94bf95d11 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:30.165828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:30.166643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:30.166929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:30.167205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] PATH_INFO: `/v3/domains/default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:30.168354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:30.169802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0255f09-cb66-4a34-bbc1-69ed46d77bed None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:30.171425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 553/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:30.177574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:30.270861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec0fb-c65d-464c-b9ec-5b67abc4690d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:30.303229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:30.303877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:30.304162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:30.304438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:30.305145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:30.306597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2aa1d-b124-4cbc-9145-d922eb8042df None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:30.325487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 585/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:44:30 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:44:32.628906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad58b-479e-4f83-a4bf-9560a3a9f8ab None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:32.629457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad58b-479e-4f83-a4bf-9560a3a9f8ab None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:32.629457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ad58b-479e-4f83-a4bf-9560a3a9f8ab None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:32.630859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 554/1139] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:32.636181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:32.636557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:32.636741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:32.654476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:32.655682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:32.718238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 586/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:32.741592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ad58b-479e-4f83-a4bf-9560a3a9f8ab None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:32.847407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ad58b-479e-4f83-a4bf-9560a3a9f8ab None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:32.887181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:32.887964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:32.888246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:32.888526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:32.900502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:32.909090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:32.910266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:32.911591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 555/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:32.916750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:33.011073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf989d-ffc0-4700-a0ca-c0056f0021c5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:33.043633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:33.044290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:33.044577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:33.044846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:33.045579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:33.045882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:33.047314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:33.056088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 587/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:33.062523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:33.156163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960e128-cfc1-4196-9ea1-0cb31949060f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:33.187992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:33.188835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:33.189120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:33.189394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] PATH_INFO: `/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:33.201892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3e4a9d7ec249c1a7e709e81b8d145e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:33.204226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:33.206107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 556/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:33 2022] GET /identity/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:33.211785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:33.305106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623ba09-4df7-4692-ad47-f22c267ef05e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:33.336098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:33.336718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:33.336999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:33.337270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:33.400499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:33.401924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:33.492172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 588/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:33.497953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:33.592642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d49f-5ffd-4ae3-8ab3-719862a29009 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:33.625151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:33.626006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:33.626289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:33.626595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] PATH_INFO: `/v3/projects/37bc52099fca4ea7954141206f7dd048` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:33.627760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] RBAC: Authorizing `identity:get_project(project_id=37bc52099fca4ea7954141206f7dd048)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:33.629180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9e48d-34fe-413b-8503-4bd5717c5542 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:33.630896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 557/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:33 2022] GET /identity/v3/projects/37bc52099fca4ea7954141206f7dd048 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:33.636980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:33.728374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f985cf-35fb-446a-930e-90a0605b7cfa None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:33.761291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:33.761860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:33.762138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:33.762406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:33.763239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=37bc52099fca4ea7954141206f7dd048, user.id=cf3e4a9d7ec249c1a7e709e81b8d145e) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:33.763545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:33.764953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8b03d-d014-4f04-baa7-58fb4c47e3bb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:33.770225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 589/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:33 2022] GET /identity/v3/role_assignments?user.id=cf3e4a9d7ec249c1a7e709e81b8d145e&scope.project.id=37bc52099fca4ea7954141206f7dd048&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:35.977150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7486-450d-4d4b-b73c-3cebeaf42917 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:35.977678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7486-450d-4d4b-b73c-3cebeaf42917 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:35.977678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc7486-450d-4d4b-b73c-3cebeaf42917 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:35.979105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 558/1147] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:35.984318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:35.984730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:35.984871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.001241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:36.002417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:36.065648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 590/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:36.088120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7486-450d-4d4b-b73c-3cebeaf42917 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:36.183338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc7486-450d-4d4b-b73c-3cebeaf42917 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:36.214506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:36.215277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:36.215561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:36.215839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.225925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:36.233477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:36.235638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:36.236497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 559/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:36.241937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:36.334925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ba07-28f4-4526-b5a3-81e07fe60332 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:36.368297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:36.369434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:36.369954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:36.370625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.371732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:36.372050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:36.373433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:36.382068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 591/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:36.387928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:36.481701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed64c-6ef2-4e7a-8b33-1517e235bf4d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:36.512686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:36.513473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:36.513751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:36.514020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] PATH_INFO: `/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.515733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3e4a9d7ec249c1a7e709e81b8d145e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:36.517156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:36.518805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 560/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:36 2022] GET /identity/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:36.524399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:36.618072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982793-9e29-4bb7-accc-9697c507aab4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:36.649776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:36.650655 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:36.650940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:36.651213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] PATH_INFO: `/v3/projects/37bc52099fca4ea7954141206f7dd048` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.652385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] RBAC: Authorizing `identity:get_project(project_id=37bc52099fca4ea7954141206f7dd048)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:36.653815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6767-c326-4f02-97c8-a3ddc514abb9 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:36.655527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 592/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:36 2022] GET /identity/v3/projects/37bc52099fca4ea7954141206f7dd048 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:36.661776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:36.758558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ee093-2a31-4f4f-87ed-2c25c127af85 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:36.790620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab857213-7649-4681-9375-75a937d4211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:36.791442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857213-7649-4681-9375-75a937d4211d None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:36.791726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857213-7649-4681-9375-75a937d4211d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:36.792003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857213-7649-4681-9375-75a937d4211d None admin] PATH_INFO: `/v3/projects/37bc52099fca4ea7954141206f7dd048/users/cf3e4a9d7ec249c1a7e709e81b8d145e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:36.793944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab857213-7649-4681-9375-75a937d4211d None admin] RBAC: Authorizing `identity:create_grant(project_id=37bc52099fca4ea7954141206f7dd048, user_id=cf3e4a9d7ec249c1a7e709e81b8d145e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:36.795391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab857213-7649-4681-9375-75a937d4211d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:36.808471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 561/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:44:36 2022] PUT /identity/v3/projects/37bc52099fca4ea7954141206f7dd048/users/cf3e4a9d7ec249c1a7e709e81b8d145e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:44:38.982978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321465f0-273d-4f6c-9f4a-6c49ef407884 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:38.983515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321465f0-273d-4f6c-9f4a-6c49ef407884 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:38.983515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321465f0-273d-4f6c-9f4a-6c49ef407884 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:38.985382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 593/1154] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:38.990474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:38.990839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:38.991053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.008767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:39.009946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:39.072650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 562/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:39.095744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321465f0-273d-4f6c-9f4a-6c49ef407884 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:39.192121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321465f0-273d-4f6c-9f4a-6c49ef407884 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:39.223530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:39.224301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:39.224586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:39.224861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.234963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:39.242351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:39.243459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:39.244498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 594/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:39.250237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:39.343626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8302c2-4b17-4d92-898d-89fb054ec1b5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:39.375333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:39.375973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:39.376249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:39.376518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.377250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:39.377550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:39.378935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:39.386591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 563/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:39.392804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:39.486316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd2bc-0ed2-4402-9fca-54711cbf0bb2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:39.518653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:39.519507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:39.519791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:39.520065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] PATH_INFO: `/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.521264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] RBAC: Authorizing `identity:get_user(user_id=cf3e4a9d7ec249c1a7e709e81b8d145e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:39.522737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:39.524356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 595/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/users/cf3e4a9d7ec249c1a7e709e81b8d145e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:39.529977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:39.624115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f978-f1b5-44fa-8c48-e1ac500400b8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:39.656040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:39.656678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:39.656960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:39.657237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.719640 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:39.721072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:39.820693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 564/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:39.826520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:39.920041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f9e62-a442-4b49-82a3-5c01dcf3a296 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:39.951786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:39.952733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:39.953014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:39.953293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] PATH_INFO: `/v3/projects/37bc52099fca4ea7954141206f7dd048` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:39.954441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=37bc52099fca4ea7954141206f7dd048)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:39.955887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813398bf-e375-4670-82bc-a8103c970eb6 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:39.957537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 596/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/projects/37bc52099fca4ea7954141206f7dd048 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:39.963532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:40.056153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21c00-d2a6-48a1-816c-9a50b956fe74 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:40.087240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:40.087809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:40.088090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:40.088366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:40.089178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=37bc52099fca4ea7954141206f7dd048, user.id=cf3e4a9d7ec249c1a7e709e81b8d145e) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:40.089486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:40.090933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92643b-9f5f-4199-92f9-8b7cd4e01f72 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:40.096934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 565/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:39 2022] GET /identity/v3/role_assignments?user.id=cf3e4a9d7ec249c1a7e709e81b8d145e&scope.project.id=37bc52099fca4ea7954141206f7dd048&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:42.313079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af52f0-1500-47a6-9b29-b93e0a49e0c6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:42.313642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af52f0-1500-47a6-9b29-b93e0a49e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:42.313642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af52f0-1500-47a6-9b29-b93e0a49e0c6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:42.315036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 597/1162] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:42.320105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:42.320517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:42.320664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:42.337417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:42.338618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:42.401667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 566/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:42.423815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af52f0-1500-47a6-9b29-b93e0a49e0c6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:42.522415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af52f0-1500-47a6-9b29-b93e0a49e0c6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:42.554823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:42.555461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:42.555747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:42.556025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:42.618941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:42.620337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:42.711564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 598/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:42.717452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:42.815872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816d703-5067-4c30-a1d3-3777cb5c2d84 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:42.847522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:42.848298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:42.848575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:42.848845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:42.855342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:42.856758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-7f7ec497-a244-4fb7-89bb-a94c546a0570 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:42.870981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:42.872006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:42.872948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 567/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:44:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:42.878261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:42.975513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ec479-bd58-4937-b24b-5f05866173f5 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:43.007773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:43.008426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:43.008711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:43.008988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:43.009735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:43.010063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:43.011462 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903172c-46a6-4cb8-954f-822c97ed35bf None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:43.018950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 599/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue May 10 19:44:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:45.203559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6803dd-b599-4f02-8c3e-cf46bf36b177 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:45.204102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6803dd-b599-4f02-8c3e-cf46bf36b177 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:45.204102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6803dd-b599-4f02-8c3e-cf46bf36b177 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:45.205487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 568/1167] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:45.211233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe567-5fba-4790-b2d7-6bc9574d263d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:45.211648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe567-5fba-4790-b2d7-6bc9574d263d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:45.211797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe567-5fba-4790-b2d7-6bc9574d263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:45.227999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d76fe567-5fba-4790-b2d7-6bc9574d263d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:45.229171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d76fe567-5fba-4790-b2d7-6bc9574d263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:45.291927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 600/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:45.314259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6803dd-b599-4f02-8c3e-cf46bf36b177 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:45.408956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6803dd-b599-4f02-8c3e-cf46bf36b177 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:45.440422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:45.441057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:45.441334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:45.441605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:45.442320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:45.443687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fc3a7-f78c-419d-8c60-7b93078d89b6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:45.457974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 569/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue May 10 19:44:45 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:47.695259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de0e0-1392-482e-a4f8-6e45fac89aaf None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:47.695830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de0e0-1392-482e-a4f8-6e45fac89aaf None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:47.695830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de0e0-1392-482e-a4f8-6e45fac89aaf None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:47.697188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 601/1170] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:47.703034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:47.703489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:47.703592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:47.720377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:47.721553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:47.784317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 570/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:44:47.807053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907de0e0-1392-482e-a4f8-6e45fac89aaf None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:47.902059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907de0e0-1392-482e-a4f8-6e45fac89aaf None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:47.934189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:47.935045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:47.935327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:47.935601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] PATH_INFO: `/v3/domains/810d99f6adca43fba3f4225e178e96d2` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:47.945411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=810d99f6adca43fba3f4225e178e96d2)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:47.946878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f5842-bf36-4c4a-8c62-ab83622a4465 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:47.948476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 602/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue May 10 19:44:47 2022] GET /identity/v3/domains/810d99f6adca43fba3f4225e178e96d2 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:47.954683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:48.047856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a696c3a-700f-43df-9e6e-a4b487ebcd9a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:48.080697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:48.081344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:48.081628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:48.081905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:48.082634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:48.084056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d48a-edd6-4c52-9907-69857e780dbb None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:48.107811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 571/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:44:47 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:50.352321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4b9d-0e64-422b-9f88-583209d3fe92 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:50.352870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4b9d-0e64-422b-9f88-583209d3fe92 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:50.352870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b4b9d-0e64-422b-9f88-583209d3fe92 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:50.354242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 603/1174] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:50.360296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:50.360882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:50.360882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:50.377782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:50.378975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:50.442113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 572/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:50.476867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4b9d-0e64-422b-9f88-583209d3fe92 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:50.579738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b4b9d-0e64-422b-9f88-583209d3fe92 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:50.611335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:50.612122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:50.612404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:50.612679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] PATH_INFO: `/v3/domains/810d99f6adca43fba3f4225e178e96d2` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:50.613839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=810d99f6adca43fba3f4225e178e96d2)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:50.615293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c33820-9b66-4212-aa33-725f4b38c72c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:50.616891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 604/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue May 10 19:44:50 2022] GET /identity/v3/domains/810d99f6adca43fba3f4225e178e96d2 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:50.622681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:50.715140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94362f27-6770-44c2-af2c-7172954512d2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:50.747369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:50.748018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:50.748301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:50.748878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:50.750073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:50.751521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765cc5b-686a-4dea-967c-8524d2b63914 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:50.770318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 573/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:44:50 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:44:53.004778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20925fa9-0b58-4b5a-a0d8-0ebbe1bbec2c None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.005319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20925fa9-0b58-4b5a-a0d8-0ebbe1bbec2c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.005319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20925fa9-0b58-4b5a-a0d8-0ebbe1bbec2c None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.006720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 605/1178] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:53.011926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.012316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.012474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.028760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:53.029985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:53.093873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 574/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:53.117078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20925fa9-0b58-4b5a-a0d8-0ebbe1bbec2c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:53.213648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20925fa9-0b58-4b5a-a0d8-0ebbe1bbec2c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:53.245213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:53.245980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.246263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.246562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.256996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:53.264929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:53.266110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:53.267150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 606/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:53.272422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:53.364753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261845ac-4caf-4e8b-8a55-e39e72df5d2f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:53.397987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262624-1235-44d6-a337-974f74575d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:53.398676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262624-1235-44d6-a337-974f74575d12 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.398960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262624-1235-44d6-a337-974f74575d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.399234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262624-1235-44d6-a337-974f74575d12 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.399971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262624-1235-44d6-a337-974f74575d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:53.400277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262624-1235-44d6-a337-974f74575d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:53.401637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262624-1235-44d6-a337-974f74575d12 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:53.410064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 575/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:53.415932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:53.511248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3e61-8ff7-43c8-aded-86cddbacc3ba None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:53.543366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:53.544224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.544510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.544787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] PATH_INFO: `/v3/users/3a5999eea6084cb4afcec89832f9d1b7` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.557264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] RBAC: Authorizing `identity:get_user(user_id=3a5999eea6084cb4afcec89832f9d1b7)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:53.558740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:53.560389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 607/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/users/3a5999eea6084cb4afcec89832f9d1b7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:53.566750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262624-1235-44d6-a337-974f74575d12 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:53.659432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262624-1235-44d6-a337-974f74575d12 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:53.691125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:53.691755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.692037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.692313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.754933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:53.756363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:53.846937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 576/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:44:53.852681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:53.953846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68f8a6-74de-48c2-add5-86cb88d3556b None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:53.985392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:53.986221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:53.986529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:53.986808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] PATH_INFO: `/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:53.987966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e14a66c3dcf6422b867be2739dbb5a3c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:53.989392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810005-5a96-45ed-8ecc-67fc0fb475f5 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:53.991078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 608/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:53.997045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:54.089505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f480f-9248-45ff-8627-ab944d3ab31e None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:54.121462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:54.122032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:54.122311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:54.122614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:54.124021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=e14a66c3dcf6422b867be2739dbb5a3c, user.id=3a5999eea6084cb4afcec89832f9d1b7) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:54.124344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:54.125743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733fb85-0393-4133-8049-f4ccaf9ab6d1 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:54.130941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 577/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:44:53 2022] GET /identity/v3/role_assignments?user.id=3a5999eea6084cb4afcec89832f9d1b7&scope.project.id=e14a66c3dcf6422b867be2739dbb5a3c&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:56.309827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fad1e-43e6-44e1-88ea-3606d36815e6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.310377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fad1e-43e6-44e1-88ea-3606d36815e6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.310377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fad1e-43e6-44e1-88ea-3606d36815e6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.312350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 609/1186] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:56.317470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.317904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.318033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.335568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:56.336732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:56.399027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 578/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:44:56.420828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fad1e-43e6-44e1-88ea-3606d36815e6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:56.516561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fad1e-43e6-44e1-88ea-3606d36815e6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:56.549083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:56.549849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.550132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.550405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.560170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:56.568125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:56.569241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:44:56.570286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 610/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:56.575223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:56.668339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97a2f-af69-4958-bd8a-7b7aea1147e6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:56.700262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:56.700906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.701180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.701562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.702292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:56.702626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:56.703967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:56.711492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 579/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:56.717165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:56.810133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb91a7-4830-4dd7-9b3d-4db6c65ca0b7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:56.841402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:56.842208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.842519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.842906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] PATH_INFO: `/v3/users/3a5999eea6084cb4afcec89832f9d1b7` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.844090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] RBAC: Authorizing `identity:get_user(user_id=3a5999eea6084cb4afcec89832f9d1b7)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:56.845523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:56.847188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 611/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:56 2022] GET /identity/v3/users/3a5999eea6084cb4afcec89832f9d1b7 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:56.852641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:56.946080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad3d-0550-4b09-985a-91e8cd698f11 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:56.976404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:56.977228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:56.977505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:56.977774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] PATH_INFO: `/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:56.978949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] RBAC: Authorizing `identity:get_project(project_id=e14a66c3dcf6422b867be2739dbb5a3c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:56.980353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8ca5e-b63c-408b-9576-91a964b81d68 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:56.981992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 580/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:44:56 2022] GET /identity/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:44:56.988403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:57.092427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed8bc-3464-4d02-98dc-657c48b0db58 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:57.124538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:57.125430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:57.125710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:57.125981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] PATH_INFO: `/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c/users/3a5999eea6084cb4afcec89832f9d1b7/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:57.127998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] RBAC: Authorizing `identity:create_grant(project_id=e14a66c3dcf6422b867be2739dbb5a3c, user_id=3a5999eea6084cb4afcec89832f9d1b7, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:57.129426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b7fb0-b8cf-4172-b1b9-2737e7bb0c8c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:57.142022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 612/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:44:56 2022] PUT /identity/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c/users/3a5999eea6084cb4afcec89832f9d1b7/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:44:59.325918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69016e-1e90-448a-92a7-36beef415f91 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.326504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69016e-1e90-448a-92a7-36beef415f91 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.326504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69016e-1e90-448a-92a7-36beef415f91 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:59.327873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 581/1193] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:44:59.333471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.333896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.334064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:59.350884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:44:59.352065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:44:59.414933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 613/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:44:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:44:59.438001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69016e-1e90-448a-92a7-36beef415f91 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:59.535287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69016e-1e90-448a-92a7-36beef415f91 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:59.566914 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:59.567683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.567969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.568247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:59.578347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:44:59.585874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:44:59.586951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:44:59.587882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 582/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:44:59.593665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:59.685833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beccca-8d39-45d4-b0a6-0178a5d2f715 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:59.718145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:59.718827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.719116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.719391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:59.720131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:44:59.720440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:59.721811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:59.729612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 614/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:59.735176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:59.828811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80b2-5b32-458d-87fa-3c2c0a9e5a5b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:59.860622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:59.861464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.861746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.862018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] PATH_INFO: `/v3/users/3a5999eea6084cb4afcec89832f9d1b7` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:44:59.863193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] RBAC: Authorizing `identity:get_user(user_id=3a5999eea6084cb4afcec89832f9d1b7)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:44:59.864616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:44:59.866212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 583/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue May 10 19:44:59 2022] GET /identity/v3/users/3a5999eea6084cb4afcec89832f9d1b7 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:44:59.871828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:44:59.965473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4b61-e40f-41bd-b6db-f9795688d194 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:44:59.996813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:44:59.997442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:44:59.997728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:44:59.998025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:45:00.062103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:45:00.063581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:45:00.155790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 615/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:44:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:45:00.161566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:45:00.258941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff551a6-d149-45ec-a6c7-744b42b8f89f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:45:00.291487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:45:00.292315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:45:00.292591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:45:00.292858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] PATH_INFO: `/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:45:00.294013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=e14a66c3dcf6422b867be2739dbb5a3c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:45:00.295557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c5bb1-1c15-44e9-ab98-5a6b664d2ba9 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:45:00.297215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 584/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue May 10 19:45:00 2022] GET /identity/v3/projects/e14a66c3dcf6422b867be2739dbb5a3c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:45:00.303342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:45:00.397452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba245f-9460-474f-b0f6-362fbe69f78e None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:45:00.429329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:45:00.429979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:45:00.430268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:45:00.430569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:45:00.431389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=e14a66c3dcf6422b867be2739dbb5a3c, user.id=3a5999eea6084cb4afcec89832f9d1b7) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:45:00.431702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:45:00.433123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe06d-4826-44f1-842a-39fadf524662 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:45:00.439275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 616/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:45:00 2022] GET /identity/v3/role_assignments?user.id=3a5999eea6084cb4afcec89832f9d1b7&scope.project.id=e14a66c3dcf6422b867be2739dbb5a3c&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:01.217876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4846-a7b7-426d-a3a0-dfadafb524a0 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:01.218568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4846-a7b7-426d-a3a0-dfadafb524a0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:01.218568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4846-a7b7-426d-a3a0-dfadafb524a0 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:01.220042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 585/1201] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:01.225502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:01.226069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:01.226182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:01.244241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:01.245967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:01.320681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 617/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:01.346846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4846-a7b7-426d-a3a0-dfadafb524a0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:01.490062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4846-a7b7-426d-a3a0-dfadafb524a0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:01.535546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:01.536356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:01.536637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:01.536909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:01.548847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:01.550302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:01.569581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:01.570725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:01.572276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:01.572276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:01.572276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:01.572276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:01.572276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 586/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:01.577450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:01.698449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60711b-5cfb-4e55-9c81-9f2fe0390cc7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:01.739219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:01.739891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:01.740344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:01.740490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:01.741222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:01.741559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:01.743065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2b2f3-c4bb-4898-8461-508836d2844f None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:01.756137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 618/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:01.762116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:01.885707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf6473-7de3-434e-a76c-e0b8b9e686a8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:01.924923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:01.925755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:01.926130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:01.926554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:01.927334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:01.928852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09201f2-ee12-449f-afd7-50961ae9f1ab None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:01.962874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 587/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue May 10 19:46:01 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:46:04.434632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2e7b-a348-4443-b938-aa9aaca57f75 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:04.435172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2e7b-a348-4443-b938-aa9aaca57f75 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:04.435172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e2e7b-a348-4443-b938-aa9aaca57f75 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:04.436562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 619/1206] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:04.444001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:04.444591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:04.444591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:04.463676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:04.465801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:04.544976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 588/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:04.568243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e2e7b-a348-4443-b938-aa9aaca57f75 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:04.700329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e2e7b-a348-4443-b938-aa9aaca57f75 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:04.736843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:04.738071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:04.738071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:04.738253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:04.750636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:04.759281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:04.760400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:04.761257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 620/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:04.766655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:04.873147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb315a0-c099-4404-b12c-722725e63184 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:04.906200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:04.906902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:04.907186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:04.907471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:04.908200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:04.908506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:04.909869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:04.919019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 589/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:04.924907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:05.027945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ba72-e579-4588-a751-5a11b0c9b680 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:05.068345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:05.069226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:05.069513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:05.069831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:05.081842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:05.083459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:05.105727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:05.106761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:05.107665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:05.107665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:05.107665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:05.107665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:05.107665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 621/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:05.113334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:05.226910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5795700-7de1-4b35-a46e-442ca918965d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:05.270704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:05.271655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:05.271969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:05.272434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:05.273368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:05.273698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:05.275967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:05.290740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 590/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:05.296338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:05.415213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323d9d0-8349-4556-96dd-881d9eaf18aa None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:05.456154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:05.456956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:05.457235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:05.457516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:05.466368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:05.468199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:05.485674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:05.487049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:05.488023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 622/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:05.492982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:05.609792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753b15-71f2-4ed7-89e1-c7993c642ccf None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:05.654877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:05.655658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:05.656005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:05.656298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:05.657297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:05.657634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:05.659378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:05.682184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 591/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:05.688751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:05.806018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f403-9060-4faf-91c9-9058580e0784 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:05.846076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:05.846835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:05.847120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:05.847395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:05.921546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:05.928364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.037207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 623/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:46:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:46:06.044054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:06.152203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc471a-d472-4257-9c37-9022f35669e4 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:06.191426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:06.192115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:06.192402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:06.192722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:06.204639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:06.206186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:06.223953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:06.224898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:06.225807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:06.225807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:06.225807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:06.225807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:06.225807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 592/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:06.231190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:06.332778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cadd88-d49d-4c8b-80a6-b4f73fdb8e31 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:06.368390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:06.369673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:06.370067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:06.370331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:06.371162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:06.371760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:06.373743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.386404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 624/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:06.391931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:06.495535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140f34-7851-41da-86ae-f45a2ed56dbf None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:06.530976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:06.531844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:06.532173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:06.532450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:06.539493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:06.541654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:06.555255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:06.557824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:06.558958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:06.562500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 593/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:06.564241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:06.677193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7940-be35-4f82-af1e-dd04ad52f8a2 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:06.714968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:06.715635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:06.715914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:06.716185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:06.716967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:06.717270 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:06.718803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5eb0d-f959-4e50-9f35-71205d22dd40 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.733723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 625/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:06.743899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:06.854032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4abd04-e806-44f0-b56b-d36effefcf0f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:06.894524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:06.895411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:06.895642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:06.895930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:06.896909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=722cc57a4637431686105db8181fdd0d) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:06.897241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:06.899147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb5846-a66f-4ef4-812d-0be34ee9edb5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:06.914731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 594/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:46:06 2022] GET /identity/v3/role_assignments?user.id=722cc57a4637431686105db8181fdd0d&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:09.213822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3ad7-97f0-4120-8d17-4948b0440034 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:09.214430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3ad7-97f0-4120-8d17-4948b0440034 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:09.214430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3ad7-97f0-4120-8d17-4948b0440034 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:09.215961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 626/1220] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:46:09.221864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:09.222330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:09.222450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:09.240794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:09.242004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:09.317163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 595/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:09.340667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3ad7-97f0-4120-8d17-4948b0440034 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:09.448966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3ad7-97f0-4120-8d17-4948b0440034 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:09.485097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:09.485969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:09.486224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:09.486515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:09.497903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:09.506295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:09.507353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:09.508959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 627/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:09.514791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:09.628310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edef32-e87a-4955-b514-33450d6b3145 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:09.668376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:09.669096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:09.669479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:09.669788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:09.670615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] RBAC: Adding query filter params (name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:09.670924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:09.672417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:09.685743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 596/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:46:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:09.687046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:09.796778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6523c2-7f08-49ca-97ea-803aed98fce6 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:09.838585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:09.839395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:09.839681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:09.839964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:09.854625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:09.856369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:09.877046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:09.878081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:09.879023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:09.879023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:09.879023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:09.879023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:09.883810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 628/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:09.885965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.000338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f1093-dddb-4bd4-885b-34f737ae21ce None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.036103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.036759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.037048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.037373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.038214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:10.038561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.040067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.053342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 597/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:10.059246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.175954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee62c-ca54-4f41-88da-a2b63c0f18fb None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.216003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.216807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.217144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.217418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.225410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.226980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:10.242375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:10.243546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:10.244594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 629/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:10.250172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.355977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfc8ed-2d54-4b40-bb2b-e88875cbf372 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.394144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596b75-a174-4261-80ad-903ced381680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.394907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596b75-a174-4261-80ad-903ced381680 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.395195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596b75-a174-4261-80ad-903ced381680 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.395470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596b75-a174-4261-80ad-903ced381680 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.396425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37596b75-a174-4261-80ad-903ced381680 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:10.396773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37596b75-a174-4261-80ad-903ced381680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.398426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37596b75-a174-4261-80ad-903ced381680 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.420213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 598/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:10.425778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.534798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070ca5-8079-49e9-b38f-1f2a5770696d None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.574787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.575572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.575856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.576132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.586531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.588155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:10.606570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:10.607512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:10.608427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:10.608427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:10.608427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:10.608427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:10.608427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 630/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:10.613763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596b75-a174-4261-80ad-903ced381680 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.716957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37596b75-a174-4261-80ad-903ced381680 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.755106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.755770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.756055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.756334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.757051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:10.757360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.758757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.770548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 599/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:10.776457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:10.882308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3908a96-69ae-4589-a5db-85e3231d3923 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:10.919727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:10.920533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:10.920796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:10.921068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:10.928166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:10.930041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:10.945242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:10.946358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:10.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 631/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:10.952757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:11.061432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b60ee-4b91-4ea6-b57f-b3be9971791f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:11.100601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:11.101280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:11.101544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:11.101816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:11.102636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:11.102945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:11.104940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b068-fafb-4132-9cab-28e7cb16c7b5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:11.124616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 600/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:11.125993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:11.240618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5782-2a26-486f-9f09-7b38ffcc4aa4 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:11.279910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:11.280830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:11.281118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:11.281398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/722cc57a4637431686105db8181fdd0d/roles/29eefb96d4434cf686aaaeadcc256b2a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:11.296238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=722cc57a4637431686105db8181fdd0d, role_id=29eefb96d4434cf686aaaeadcc256b2a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:11.297865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd4fdb-7067-48fc-98fc-b64ade8dd00e None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:11.310313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 632/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:46:11 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/722cc57a4637431686105db8181fdd0d/roles/29eefb96d4434cf686aaaeadcc256b2a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:46:13.741740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b86a0-fc47-4b3e-9650-d77746fa5564 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:13.742278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b86a0-fc47-4b3e-9650-d77746fa5564 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:13.742278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b86a0-fc47-4b3e-9650-d77746fa5564 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:13.744286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 601/1233] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:13.750344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:13.750814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:13.750952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:13.770926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:13.772136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:13.850512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 633/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:13.867916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b86a0-fc47-4b3e-9650-d77746fa5564 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:13.976449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b86a0-fc47-4b3e-9650-d77746fa5564 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.013337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.014133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.014418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.014725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] PATH_INFO: `/v3/roles/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.025998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:14.034011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:14.035192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:14.036284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 602/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue May 10 19:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:14.041613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:14.148513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafe93a-ac4d-4eb5-b1ac-345b506ccb9f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.183752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.184456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.184748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.185096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.186156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] RBAC: Adding query filter params (name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:14.186491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:14.188308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:14.199459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 634/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:14.205253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:14.324634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b61e-f05f-409c-8afd-30438e0542db None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.361302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.362157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.362438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.362805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.375253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:14.376702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:14.396004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:14.397332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:14.398499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:14.398499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:14.398499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:14.398499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:14.398499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 603/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:14.404756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:14.510740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd23466-4bca-4ceb-a141-ca11a13ef890 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.549248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.549909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.550190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.550473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.551208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:14.551528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:14.552912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:14.564721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 635/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:14.570237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:14.682548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce792f-3b64-4078-9e04-4bdf50c8ead6 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.717925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.718760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.719044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.719319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.727621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:14.729607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:14.744521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:14.746420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:14.747638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 604/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:14.751948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:14.861271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe8523-3f59-4272-956a-482d30e4adfe None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:14.896044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:14.896707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:14.896986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:14.897264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:14.898094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:14.898405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:14.899887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:14.917956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 636/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:14.923987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:15.025901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05061-377a-4e7e-a87b-989f45c972a3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:15.061139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:15.061804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:15.062156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:15.062572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:15.139727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:15.141256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:15.247236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 605/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:46:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 19:46:15.252909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:15.358727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b33ef-76da-42f7-886f-14052071f1a1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:15.394567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:15.395561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:15.395912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:15.396189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:15.407848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:15.409567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:15.428850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:15.429984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:15.431221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:15.431221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:15.431221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:15.431221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:15.431221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 637/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:15.436117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:15.547226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55542b-2076-4eb1-90d3-f7d2dcdcd5aa None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:15.587317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:15.587988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:15.588280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:15.588554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:15.589280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:15.589587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:15.591049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:15.604012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 606/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:15.610048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:15.716637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cded96e-7037-4588-a5ac-212b6d8d85fb None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:15.754134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:15.754976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:15.755294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:15.755537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:15.762383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:15.763910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:15.778222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:15.779361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:15.780325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 638/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:15.785768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:15.894902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ecca7-5093-4b7b-9f40-8a5b36625a66 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:15.934928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:15.935599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:15.935883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:15.936162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:15.936958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:15.937269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:15.938729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b505d-7cc0-4db8-8f8a-1a810bef6929 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:15.952629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 607/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:15.959537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:16.067645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e9553-5fa3-4729-86b8-9495e6de4696 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:16.106867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:16.107922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:16.108358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:16.108744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:16.109616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] RBAC: Adding query filter params (role.id=29eefb96d4434cf686aaaeadcc256b2a, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=722cc57a4637431686105db8181fdd0d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:16.110207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:16.112257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a43ec-c1d5-49e9-a505-e570cc575e07 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:16.122961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 639/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:46:15 2022] GET /identity/v3/role_assignments?user.id=722cc57a4637431686105db8181fdd0d&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=29eefb96d4434cf686aaaeadcc256b2a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:18.529707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7b66-a079-4eb8-a197-5c1c48b410af None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:18.530197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7b66-a079-4eb8-a197-5c1c48b410af None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:18.530424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7b66-a079-4eb8-a197-5c1c48b410af None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:18.531873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 608/1247] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:18.537571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:18.538120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:18.538230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:18.556750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:18.557937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:18.627263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 640/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:46:18.653441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7b66-a079-4eb8-a197-5c1c48b410af None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:18.768098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7b66-a079-4eb8-a197-5c1c48b410af None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:18.806141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:18.806888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:18.807176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:18.807506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:18.819801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:18.828224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:18.829331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:18.830252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 609/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:18.835870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:18.936223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1602-5894-432d-9c9b-a92643d58dce None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:18.972330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:18.973177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:18.973463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:18.973925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:18.974690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:18.974994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:18.976373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:18.986620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 641/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:18.992835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:19.104136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4c733-9469-4450-9d60-12910d681325 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:19.140888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:19.141694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:19.141971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:19.142244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:19.154508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:19.156293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:19.177707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:19.178941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:19.180034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:19.180034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:19.180034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:19.180034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:19.180034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 610/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:19.185429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:19.291673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7efb96-c10c-41fc-ba00-4f851f8b9984 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:19.327921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:19.328603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:19.328936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:19.329293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:19.330679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:19.331315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:19.333547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:19.347799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 642/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:19.354867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:19.460730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2def1-5a18-48b9-be80-e2119455e32f None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:19.494755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:19.495652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:19.496259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:19.496606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:19.504388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:19.505908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:19.520957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:19.521997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:19.525943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 611/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:19.529004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:19.634900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a623f-35b9-4497-8389-8ea61444d1df None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:19.675268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:19.676002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:19.676288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:19.676613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:19.677545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:19.677915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:19.679555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:19.697528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 643/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:19.703561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:19.809706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1b65-bb1f-49d2-9c4a-3fdda3ecc2c8 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:19.843232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:19.843877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:19.844158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:19.844438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:19.918308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:19.922178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.029069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 612/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:46:20.035107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:20.149285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb68405-a364-4efc-be08-1f21e51fefd1 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:20.184542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:20.185259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:20.185550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:20.185824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:20.197533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:20.199057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:20.219685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:20.220815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:20.226540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:20.226540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:20.226540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:20.226540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:20.226540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 644/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:20.226907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:20.326989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5f9a-f4b9-4980-a374-08750a903636 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:20.359680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:20.360337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:20.360636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:20.360896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:20.361611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:20.361917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:20.363305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.375011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 613/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:20.380805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:20.478482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31446-182f-482d-bc08-a369c035ff44 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:20.511572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:20.512350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:20.512629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:20.512901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:20.519792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:20.521269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:20.536695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:20.537787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:20.538814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 645/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:20.544672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:20.642090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec73a-096d-400d-b52a-78afeb5b7c23 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:20.673611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:20.674256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:20.674563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:20.674840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:20.675615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:20.675922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:20.677342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6533df8-0a7a-41a8-9747-3a06f503ce93 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.689262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 614/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:20.695243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:20.789074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc29ffe-9242-40e2-9fa6-f218eea2f9f7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:20.820827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:20.821476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:20.821758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:20.822034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:20.822873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=722cc57a4637431686105db8181fdd0d) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:20.823183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:20.824600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca5ce-9e74-4cd9-b686-fa38b55d68c7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:20.829779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 646/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:46:20 2022] GET /identity/v3/role_assignments?user.id=722cc57a4637431686105db8181fdd0d&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:23.016314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3826-64ce-43cb-a84d-ee584fe42d27 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.016865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3826-64ce-43cb-a84d-ee584fe42d27 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.016966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3826-64ce-43cb-a84d-ee584fe42d27 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.018344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 615/1261] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:23.024704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.025155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.025255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.043703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:23.044891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:23.118056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 647/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:23.142800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3826-64ce-43cb-a84d-ee584fe42d27 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:23.236511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3826-64ce-43cb-a84d-ee584fe42d27 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:23.268531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:23.269242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.269525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.269801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.280025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:23.287551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:23.288574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:23.289434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 616/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:23.295262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:23.394113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5a290-87c8-41b6-9c54-321fd6ba3d45 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:23.426973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:23.427633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.427920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.428196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.428934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:23.429242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:23.430647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:23.438341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 648/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:23.444123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:23.539355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889acc9-2c55-40fb-aea8-055969068af1 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:23.571845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:23.572622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.572907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.573185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.583279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:23.584707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:23.601564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:23.603190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:23.604275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:23.604275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:23.604275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:23.604275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:23.604275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 617/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:23.608942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:23.709528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4afd8d-8d38-4aec-b302-95c9c2335d92 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:23.741489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:23.742131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.742419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.742725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.744047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:23.744353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:23.745966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:23.758204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 649/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:23.763850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:23.858088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359658-e24e-4a22-87ff-053a7f717812 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:23.890009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:23.890805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:23.891089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:23.891366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:23.898543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:23.899994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:23.913980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:23.915618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:23.916581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 618/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:23.921324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.015209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e908346-7c9e-425b-85e5-0155458437cf None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.047611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.048266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.048552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.048826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.049658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:24.049967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.051421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.069232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 650/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:24.076960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.177583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b58fc-1d0c-4d17-adea-357c3749b615 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.209694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.210499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.210787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.211066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.221907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.223371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:24.239545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:24.240595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:24.241832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:24.241832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:24.241832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:24.241832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:24.241832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 619/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:24.247556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.341681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af5c9-fb36-4176-ad2e-0793cf1266e7 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.373793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.374444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.374759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.375035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.375746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:24.376054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.377419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.388283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 651/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:24.393777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.486930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89b9a-0096-401f-b54c-61aae071c9dc None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.518764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.519539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.519812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.520079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.527014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.528444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:24.543520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:24.544550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:24.545746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 620/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:24.550343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.644000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2235b9-ac4f-4b5c-8cad-4237a0566502 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.675371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.676016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.676305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.676580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.677361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:24.677671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.679125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8073f9-d2f2-487f-925e-bd83cee0f857 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.692132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 652/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:46:24.700082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:24.796092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f8fd4-29cc-4962-97f7-fe0ef3d7f785 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:24.828389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:24.829244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:24.829519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:24.829786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] PATH_INFO: `/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/722cc57a4637431686105db8181fdd0d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:24.831708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=95e34f16a16e4e82bb78ee2313e9a3e6, user_id=722cc57a4637431686105db8181fdd0d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:24.833123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dab1fe-bf09-474e-91bc-2d84cc7f93f8 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:24.845761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 621/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue May 10 19:46:24 2022] PUT /identity/v3/projects/95e34f16a16e4e82bb78ee2313e9a3e6/users/722cc57a4637431686105db8181fdd0d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:46:27.041030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431534-d69b-40a4-8ffc-00bf50fd4598 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.041586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431534-d69b-40a4-8ffc-00bf50fd4598 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.041586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431534-d69b-40a4-8ffc-00bf50fd4598 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.042992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 653/1274] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:27.048073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.048444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.048623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.066006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:27.067549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:27.138067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 622/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:27.161274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29431534-d69b-40a4-8ffc-00bf50fd4598 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:27.256497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29431534-d69b-40a4-8ffc-00bf50fd4598 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:27.288672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:27.289432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.289831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.290107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.299630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 19:46:27.307769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:27.308858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:27.309780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 654/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:27.314759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:27.407437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03fde-a19f-47ae-a0e7-afa588aa4486 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:27.440073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:27.440727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.441009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.441284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.442031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:27.442337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:27.443732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:27.451418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 623/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:27.456883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:27.550724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dc6d-91d7-42c7-9b97-9ac6a8076a4a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:27.582506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:27.583277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.583556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.583828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.595200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:27.596626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:27.613340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:27.614381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:27.615357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:27.615357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:27.615357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:27.615357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:27.615357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 655/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:27.621223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:27.715983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c8c0-2c2a-4447-8672-17551d99f62b None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:27.748170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:27.748819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.749100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.749372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.750076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:27.750381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:27.751757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:27.763551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 624/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:27.769137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:27.862300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d86ea-20db-4568-ab84-867fefcf7f62 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:27.892775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:27.893550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:27.893830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:27.894102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:27.901606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:27.903055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 19:46:27.917389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:27.918506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:27.919515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 656/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 19:46:27.924269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.018244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6133-7a7f-4166-80aa-f31f4fc0d8ba None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.049174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.049819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.050096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.050366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.051210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:28.051509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.052907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.072946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 625/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue May 10 19:46:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:28.081505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.185912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e705a-5963-4b2f-943d-f5648c61d37a None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.216851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.217488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.217775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.218055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.282893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.284335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.376464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 657/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue May 10 19:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 19:46:28.382217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.475354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d027-e24a-48c4-a7c4-f35db7a99981 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.507084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.507863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.508144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.508935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.521980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.523842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 19:46:28.543757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:28.544812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:28.545745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 19:46:28.545745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 19:46:28.545745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 19:46:28.545745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:28.545745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 626/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:28.550568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.644977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917acb3-1f76-43ef-b1a1-193b80323a02 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.676693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.677338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.677626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.677906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.678650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:28.678962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.680988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.692083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 658/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue May 10 19:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:28.698321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.791097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd410c27-e3da-4d38-98ee-02a507424589 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.823927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.824692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.824974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.825249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.831648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.833069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 19:46:28.847292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application with Lock( May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:28.848333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: ERROR keystone.server.flask.application May 10 19:46:28.849413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 627/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue May 10 19:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:28.854271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:28.950739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962726-f0c5-4efe-a87e-a6cd0968802c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:28.982022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:28.982689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:28.982992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:28.983271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:28.984040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:28.984346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:28.985765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3604ac-21ca-411f-8915-2ae8b291a0f8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:28.997948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 659/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue May 10 19:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:29.003908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:29.105033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897117b8-27c0-43bc-9b9b-079411fa52b3 None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:29.136881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:29.137518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:29.137803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:29.138082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:29.138938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] RBAC: Adding query filter params (role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6, scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6, user.id=722cc57a4637431686105db8181fdd0d) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:29.139253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:29.140688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25513a-f63b-4ac2-a6d4-c42139171cb4 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:29.146269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 628/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue May 10 19:46:29 2022] GET /identity/v3/role_assignments?user.id=722cc57a4637431686105db8181fdd0d&scope.project.id=95e34f16a16e4e82bb78ee2313e9a3e6&role.id=cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:31.370710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559b416-f0b6-4ddd-a7b0-e42e81a2045c None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:31.371236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559b416-f0b6-4ddd-a7b0-e42e81a2045c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:31.371349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559b416-f0b6-4ddd-a7b0-e42e81a2045c None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:31.372659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 660/1288] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:31.377701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:31.378098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:31.378251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:31.394427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:31.395626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:31.462007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 629/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 19:46:31.484179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559b416-f0b6-4ddd-a7b0-e42e81a2045c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:31.581009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559b416-f0b6-4ddd-a7b0-e42e81a2045c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:31.612220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:31.613002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:31.613286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:31.613559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:31.614202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:31.615600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:31.627700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:31.628902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:31.630062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 661/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:46:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:31.635508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:31.725569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a78578-4c6e-493e-b4a3-c526e94b1db3 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:31.759343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:31.759985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:31.760262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:31.760534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:31.761228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] RBAC: Adding query filter params (name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:31.761530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:31.762921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef212f-6502-430c-ba67-c380fd96a17a None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:31.767497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 630/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 19:46:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:31.773221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:31.867620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f1cff-9686-43b0-9e73-8a195e869250 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:31.899554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:31.900135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:31.900415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:31.900685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] PATH_INFO: `/v3/services` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:31.901372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:31.901673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:31.903052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07605f22-5134-4b59-b50f-a85bc6152d61 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:31.907240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 662/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 19:46:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:34.124653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29335-c09e-4b2f-afa2-95e4806c75c9 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:34.125402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29335-c09e-4b2f-afa2-95e4806c75c9 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:34.125402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29335-c09e-4b2f-afa2-95e4806c75c9 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:34.126641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 631/1293] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:34.133394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cff0b-fddf-48ad-a94c-baec0acb4719 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:34.133920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cff0b-fddf-48ad-a94c-baec0acb4719 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:34.134186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cff0b-fddf-48ad-a94c-baec0acb4719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:34.155898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b97cff0b-fddf-48ad-a94c-baec0acb4719 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:34.157071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b97cff0b-fddf-48ad-a94c-baec0acb4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:34.219871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 663/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:34.241776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29335-c09e-4b2f-afa2-95e4806c75c9 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:34.338536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29335-c09e-4b2f-afa2-95e4806c75c9 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:34.370312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:34.371236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:34.371521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:34.371798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:34.372517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:34.373875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9edfe-1ea2-45b1-a403-1ce140281457 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:34.386959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 632/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue May 10 19:46:34 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:46:36.594824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886162-a182-441b-8ecb-e4152fe6ce16 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:36.595334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886162-a182-441b-8ecb-e4152fe6ce16 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:36.595439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886162-a182-441b-8ecb-e4152fe6ce16 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:36.596758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 664/1296] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:36.602545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:36.602917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:36.603098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:36.619755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:36.621188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:36.689012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 633/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:36.711067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e886162-a182-441b-8ecb-e4152fe6ce16 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:36.806767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e886162-a182-441b-8ecb-e4152fe6ce16 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:36.838974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:36.839752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:36.840029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:36.840301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:36.840943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:36.842317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:36.854139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:36.855331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:36.856240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 665/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:46:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:36.861575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:36.955791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99091e-d905-4cda-8b9e-121d5e733dae None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:36.987178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f203b-d045-4068-a495-63976449870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:36.987816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f203b-d045-4068-a495-63976449870d None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:36.988096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f203b-d045-4068-a495-63976449870d None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:36.988367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f203b-d045-4068-a495-63976449870d None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:36.989057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f203b-d045-4068-a495-63976449870d None admin] RBAC: Adding query filter params (name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:36.989360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f203b-d045-4068-a495-63976449870d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:36.990733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f203b-d045-4068-a495-63976449870d None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:36.996322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 634/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 19:46:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:37.001987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:37.100599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d37757-3edc-4df3-9c77-0a30a530e215 None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:37.134861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:37.135409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:37.135692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:37.135972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:37.136867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] RBAC: Adding query filter params (interface=public, service_id=68657978e24a4251a598134e07394bb3, region_id=RegionOne) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:37.137169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:37.138607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389a498-0c68-45f8-885d-614b3fce0cf8 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:37.143557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 666/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue May 10 19:46:37 2022] GET /identity/v3/endpoints?service_id=68657978e24a4251a598134e07394bb3&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:37.149722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f203b-d045-4068-a495-63976449870d None admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:37.243876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f203b-d045-4068-a495-63976449870d None admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:37.276157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:37.276795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:37.277073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:37.277343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:37.278006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:37.279392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7c49e-34f2-4eb1-9a79-399768096309 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:37.285847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 635/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue May 10 19:46:37 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:46:39.482264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0dddb-b039-42f3-90ff-54c141f73d3b None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:39.482861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0dddb-b039-42f3-90ff-54c141f73d3b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:39.482861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0dddb-b039-42f3-90ff-54c141f73d3b None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:39.484227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 667/1302] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:46:39.489614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:39.490002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:39.490174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:39.506565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:46:39.508234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:46:39.572161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 636/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:46:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 19:46:39.594991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0dddb-b039-42f3-90ff-54c141f73d3b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:39.692403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0dddb-b039-42f3-90ff-54c141f73d3b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:39.723153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:39.723926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:39.724213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:39.724490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] PATH_INFO: `/v3/services/placement` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:39.725135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:39.727178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 19:46:39.738676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 19:46:39.739859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.get_or_create( May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application with Lock( May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self._enter() May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application return self.creator() May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application created_value = creator( May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: ERROR keystone.server.flask.application May 10 19:46:39.740990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 668/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue May 10 19:46:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 19:46:39.746644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:39.842802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eec6-2a59-47e1-954f-f048d522b75d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:39.874720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:39.875371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:39.875652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:39.875926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] PATH_INFO: `/v3/services` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:39.876631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:46:39.876936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:39.878287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f167a-702f-48bf-972e-bd9e0075f3d5 None admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:39.883250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 637/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue May 10 19:46:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:46:39.890020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:46:39.984790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b70095-4a93-41de-bc77-052e5311e05c None admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:46:40.017230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:46:40.017809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:46:40.018096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:46:40.018373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:46:40.019133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:46:40.020511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bd4e6-bfcf-4d49-84c5-1e2f426683e7 None admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:46:40.037964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 669/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue May 10 19:46:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:47:43.509177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538cce-0b62-404b-aaf3-6e1ae2d2e929 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:43.509764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538cce-0b62-404b-aaf3-6e1ae2d2e929 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:43.509764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538cce-0b62-404b-aaf3-6e1ae2d2e929 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:43.511104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 638/1307] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:43.516204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40bc3-e0ee-4f4c-9c58-85fc831c6053 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:43.516608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40bc3-e0ee-4f4c-9c58-85fc831c6053 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:43.516771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40bc3-e0ee-4f4c-9c58-85fc831c6053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:43.587082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-54f40bc3-e0ee-4f4c-9c58-85fc831c6053 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:43.588488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-54f40bc3-e0ee-4f4c-9c58-85fc831c6053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:43.698519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 670/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:43.747183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:43.747471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:43.747778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:43.749409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 639/1309] 10.222.0.57 () {54 vars in 964 bytes} [Tue May 10 19:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:43.757818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5680a-f8e8-49c7-9ffc-ea0ddf358389 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:43.758097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5680a-f8e8-49c7-9ffc-ea0ddf358389 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:43.758404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5680a-f8e8-49c7-9ffc-ea0ddf358389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:43.867010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-87c5680a-f8e8-49c7-9ffc-ea0ddf358389 None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:43.868551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-87c5680a-f8e8-49c7-9ffc-ea0ddf358389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:43.966483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 671/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Tue May 10 19:47:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:43.976695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:47:43.978559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:44.093665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e45bf-26da-472a-a034-ad17a07c39ed None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:47:44.172226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:47:44.172883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:44.173159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:44.173610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:44.175454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:44.291797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:47:44.293807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75154a8-e681-43c6-a2c1-7439c9fa27a6 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:47:44.313944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 640/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:47:46.926600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:46.927106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:46.927106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:46.928450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 672/1312] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:46.933932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20b35-313c-4a02-b2bb-be17a3451f4f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:46.934356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20b35-313c-4a02-b2bb-be17a3451f4f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:46.934544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20b35-313c-4a02-b2bb-be17a3451f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:47.024064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-15c20b35-313c-4a02-b2bb-be17a3451f4f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:47.025302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-15c20b35-313c-4a02-b2bb-be17a3451f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:47.150548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 641/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:47.192070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:47:47.193605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:47.301417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df8a9c-c9d3-47ac-ad63-797cd43fa7dd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:47:47.381743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:47:47.382847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:47.383225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:47.383606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:47.385420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:47.493288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:47:47.494764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bef11-d7cb-45dd-837d-0781380da5e5 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:47:47.512496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 673/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:47:50.062670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:50.063233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:50.063233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:50.064609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 642/1315] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:50.070251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408a26-1744-4045-a3e6-c8681ebd2338 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:50.070689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408a26-1744-4045-a3e6-c8681ebd2338 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:50.070995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408a26-1744-4045-a3e6-c8681ebd2338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:50.134706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b4408a26-1744-4045-a3e6-c8681ebd2338 None None] MFA Rules not processed for user `35f74ce2156e467aabcf37500a18909d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:50.135930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b4408a26-1744-4045-a3e6-c8681ebd2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:50.228451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 674/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:47:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:50.267506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:47:50.269611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:50.375054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023a475-1233-48f1-a930-7f9d71a71a36 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:47:50.451553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:47:50.452218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:50.452500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:50.452778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:50.454429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:50.559254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:47:50.560690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eef342-cd17-4664-8c8b-e5a97e239edf service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:47:50.578799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 643/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:47:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:47:53.346177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aeb4-6348-455d-b4ab-3008b886f651 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:53.346799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aeb4-6348-455d-b4ab-3008b886f651 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:53.346799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4aeb4-6348-455d-b4ab-3008b886f651 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:53.348144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 675/1318] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:53.353289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f47b6-3e12-44f8-8180-a5472cd223ea None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:53.353737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f47b6-3e12-44f8-8180-a5472cd223ea None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:53.353833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f47b6-3e12-44f8-8180-a5472cd223ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:53.417695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4b4f47b6-3e12-44f8-8180-a5472cd223ea None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:53.418939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4b4f47b6-3e12-44f8-8180-a5472cd223ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:53.511976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 644/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:47:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:53.565920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:53.566209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:53.566507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:53.567889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 676/1320] 10.222.0.57 () {54 vars in 964 bytes} [Tue May 10 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:53.573825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae801-e25c-4d54-a276-9c45aab62212 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:53.574159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae801-e25c-4d54-a276-9c45aab62212 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:53.574446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae801-e25c-4d54-a276-9c45aab62212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:53.646804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-bc2ae801-e25c-4d54-a276-9c45aab62212 None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:53.647921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bc2ae801-e25c-4d54-a276-9c45aab62212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:53.719639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 645/1321] 10.222.0.57 () {58 vars in 1061 bytes} [Tue May 10 19:47:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:53.728651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:47:53.730176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:53.829603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969879e-4be1-4ed4-9707-3175ef7a1f9a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:47:53.900569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:47:53.901141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:53.901424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:53.901698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:53.903350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:54.007389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:47:54.008822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be66cbb-658c-4cb0-91eb-86c1de1f4833 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:47:54.026464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 677/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:47:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:47:57.382800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:57.383441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:57.383441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:57.384775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 646/1323] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:47:57.390205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcb0a-3d1b-4878-a07a-7ea8fb87aa68 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:57.390648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcb0a-3d1b-4878-a07a-7ea8fb87aa68 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:57.390938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcb0a-3d1b-4878-a07a-7ea8fb87aa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:57.452839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f2bfcb0a-3d1b-4878-a07a-7ea8fb87aa68 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:47:57.454025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f2bfcb0a-3d1b-4878-a07a-7ea8fb87aa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:57.553070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 678/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:47:57.588262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:47:57.589924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:57.692141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27af59-76b1-49b8-bb65-e6be89130264 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:47:57.763641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:47:57.764286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:47:57.764572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:47:57.764849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:47:57.766505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:47:57.873234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:47:57.874753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb1331-3f5a-46e6-9a64-ba2da7ed26c2 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:47:57.895309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 647/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:48:00.181799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:00.182314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:00.182314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:00.183683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 679/1326] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:00.188950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a54df-a542-41e7-9ef6-392359de6348 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:00.189361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a54df-a542-41e7-9ef6-392359de6348 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:00.189628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a54df-a542-41e7-9ef6-392359de6348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:00.253591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4c5a54df-a542-41e7-9ef6-392359de6348 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:00.254843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4c5a54df-a542-41e7-9ef6-392359de6348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:00.351168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 648/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:48:00.391812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:00.393743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:00.494040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bd82a-f3eb-4cd1-9227-34ce444a216a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:00.564135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:00.564799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:00.565086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:00.565368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:00.567016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:00.674997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:00.676450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295877e-884b-4bba-836e-1716ad942027 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:00.695426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 680/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:02.973731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:02.974299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:02.974299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:02.975742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 649/1329] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:02.981096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca173d0-0043-4f25-bcf5-d2be0f1ccabc None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:02.981516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca173d0-0043-4f25-bcf5-d2be0f1ccabc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:02.981692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca173d0-0043-4f25-bcf5-d2be0f1ccabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:03.046162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0ca173d0-0043-4f25-bcf5-d2be0f1ccabc None None] MFA Rules not processed for user `35f74ce2156e467aabcf37500a18909d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:03.047418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0ca173d0-0043-4f25-bcf5-d2be0f1ccabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:03.143557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 681/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:03.181016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:03.182635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:03.284371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173f24-f036-486c-bcfe-9ecc0f1c1227 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:03.354617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:03.355267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:03.355552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:03.355828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:03.357444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:03.462886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:03.464339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958eddc7-f5c0-45b5-bb8d-5354e46e780a service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:03.482115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 650/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:05.937206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:05.937753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:05.937753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:05.939191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 682/1332] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:05.944763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff455ab-1d08-4fb8-b014-5533441c8421 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:05.945209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff455ab-1d08-4fb8-b014-5533441c8421 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:05.945330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff455ab-1d08-4fb8-b014-5533441c8421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:06.009753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-dff455ab-1d08-4fb8-b014-5533441c8421 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:06.010923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dff455ab-1d08-4fb8-b014-5533441c8421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:06.106261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 651/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:06.141080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:06.143153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:06.245866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758cc5-ac76-4642-9acd-6ea1b6c82104 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:06.318204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:06.318817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:06.319104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:06.319383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:06.320999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:06.428354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:06.430949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39de2-bf8b-4554-bb1c-f86549e8aa3a service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:06.449341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 683/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:08.716192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:08.716764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:08.716764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:08.718282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 652/1335] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:08.723525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac9e0-c58b-4e43-9e50-acf66652af3e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:08.723963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac9e0-c58b-4e43-9e50-acf66652af3e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:08.724089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfac9e0-c58b-4e43-9e50-acf66652af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:08.788802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7dfac9e0-c58b-4e43-9e50-acf66652af3e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:08.789945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7dfac9e0-c58b-4e43-9e50-acf66652af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:08.882539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 684/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:08.921995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:08.923534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:09.024090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d3483-c78d-4005-9304-966fa544610f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:09.093346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:09.093912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:09.094189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:09.094480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:09.096767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:09.200885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:09.202310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c419cf-1eca-472c-a315-bcca869c5798 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:09.219318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 653/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:11.843471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:11.843968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:11.843968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:11.845846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 685/1338] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:11.851037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa41e-a8a8-4793-b5f7-27bbf0a5dffd None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:11.851463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa41e-a8a8-4793-b5f7-27bbf0a5dffd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:11.851604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aa41e-a8a8-4793-b5f7-27bbf0a5dffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:11.914040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-360aa41e-a8a8-4793-b5f7-27bbf0a5dffd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:11.915293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-360aa41e-a8a8-4793-b5f7-27bbf0a5dffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:12.012163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 654/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:12.048362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:12.049874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:12.150745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a825d3-8f65-45ea-b378-a88e129d0ef6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:12.220261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:12.220925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:12.221208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:12.221480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:12.223132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:12.326435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:12.327965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858955ad-c660-4b9a-85c6-d825b48efb08 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:12.346544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 686/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:16.536697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:16.537166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:16.537278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:16.538654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 655/1341] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:16.544028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e6d3-8ba8-4721-9fb0-dd0d6062fdc1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:16.544429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e6d3-8ba8-4721-9fb0-dd0d6062fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:16.544661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e6d3-8ba8-4721-9fb0-dd0d6062fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:16.615223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c850e6d3-8ba8-4721-9fb0-dd0d6062fdc1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:16.616413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c850e6d3-8ba8-4721-9fb0-dd0d6062fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:16.716699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 687/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:48:16.755563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:16.757726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:16.849490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20491ed-8feb-482a-a681-db4665f3ec6a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:16.852989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:16.853629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:16.853910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:16.854187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:16.863645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:16.865068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcb61b-a0ba-4a50-924e-de1789bb0338 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:16.874537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 656/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:19.635024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237f7-79b5-48ca-a6fb-3e922dbcd618 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:19.635556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237f7-79b5-48ca-a6fb-3e922dbcd618 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:19.635556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7237f7-79b5-48ca-a6fb-3e922dbcd618 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:19.636929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 688/1344] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:19.642237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4edb7b-608c-4bdc-ac49-268919b75e38 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:19.642665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4edb7b-608c-4bdc-ac49-268919b75e38 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:19.642774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4edb7b-608c-4bdc-ac49-268919b75e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:19.669372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5f4edb7b-608c-4bdc-ac49-268919b75e38 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:19.670593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5f4edb7b-608c-4bdc-ac49-268919b75e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:19.746404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 657/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:19.783465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7237f7-79b5-48ca-a6fb-3e922dbcd618 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:19.793955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7237f7-79b5-48ca-a6fb-3e922dbcd618 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:19.797439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:19.798628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:19.798919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:19.799195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:19.807826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:19.809265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16107ce1-275e-4e6a-8da3-ba2f94af28b9 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:19.818555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 689/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:24.081694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4b20-0df8-4e1d-8fd6-a9f217bfd849 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:24.082258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4b20-0df8-4e1d-8fd6-a9f217bfd849 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:24.082258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4b20-0df8-4e1d-8fd6-a9f217bfd849 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:24.083735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 658/1347] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:24.088922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209902d-7648-419c-af98-944e2272a172 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:24.089361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209902d-7648-419c-af98-944e2272a172 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:24.089466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209902d-7648-419c-af98-944e2272a172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:24.108086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3209902d-7648-419c-af98-944e2272a172 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:24.109264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3209902d-7648-419c-af98-944e2272a172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:24.118080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 690/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:24.155343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4b20-0df8-4e1d-8fd6-a9f217bfd849 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:24.165862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4b20-0df8-4e1d-8fd6-a9f217bfd849 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:24.169317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:24.169938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:24.170216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:24.170512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:24.180117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:24.181756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da369-f5b5-43b5-a094-14f50496ffd6 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:24.193404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 659/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:48:29.512298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7de48-3f73-49fb-a8e2-82f541774237 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:29.513166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7de48-3f73-49fb-a8e2-82f541774237 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:29.513596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7de48-3f73-49fb-a8e2-82f541774237 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:29.515800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 691/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:48:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:29.520913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbba7-058d-4418-8399-5ab981a3cc89 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:29.523816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbba7-058d-4418-8399-5ab981a3cc89 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:29.524503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cbba7-058d-4418-8399-5ab981a3cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:29.597574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7b8cbba7-058d-4418-8399-5ab981a3cc89 None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:29.600212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7b8cbba7-058d-4418-8399-5ab981a3cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:29.687643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 660/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:48:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:34.157073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b7b-7740-4892-90b8-d9329683c373 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:34.157617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b7b-7740-4892-90b8-d9329683c373 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:34.157617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b7b-7740-4892-90b8-d9329683c373 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:34.159103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 692/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:34.164085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f9ff-de2c-43f0-8939-d05f0828a0a8 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:34.164572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f9ff-de2c-43f0-8939-d05f0828a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:34.164879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f9ff-de2c-43f0-8939-d05f0828a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:34.184960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-29e1f9ff-de2c-43f0-8939-d05f0828a0a8 None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:34.186343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-29e1f9ff-de2c-43f0-8939-d05f0828a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:34.196291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 661/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:48:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:35.637738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92444-0c54-407f-9518-2fce5b200eca None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:35.638254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92444-0c54-407f-9518-2fce5b200eca None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:35.638406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92444-0c54-407f-9518-2fce5b200eca None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:35.639812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 693/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:35.644926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df4a3-1e1e-4c1e-9445-f1b0fa7cf90e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:35.645344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df4a3-1e1e-4c1e-9445-f1b0fa7cf90e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:35.645593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df4a3-1e1e-4c1e-9445-f1b0fa7cf90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:35.664199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-587df4a3-1e1e-4c1e-9445-f1b0fa7cf90e None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:35.665474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-587df4a3-1e1e-4c1e-9445-f1b0fa7cf90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:35.674712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 662/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:48:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:39.573057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4fd0-19cb-4737-a702-bd698404fe53 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:39.573578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4fd0-19cb-4737-a702-bd698404fe53 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:39.573856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4fd0-19cb-4737-a702-bd698404fe53 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:39.575527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 694/1356] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:39.580679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07f17-2cc7-4585-aa9a-4dfa7ecfbd4c None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:39.581154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07f17-2cc7-4585-aa9a-4dfa7ecfbd4c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:39.581239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07f17-2cc7-4585-aa9a-4dfa7ecfbd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:39.599509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b9c07f17-2cc7-4585-aa9a-4dfa7ecfbd4c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:39.600836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b9c07f17-2cc7-4585-aa9a-4dfa7ecfbd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:39.609138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 663/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:39.655674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca2e3-4ebc-438f-96d7-118b40ad6dda None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:39.655967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca2e3-4ebc-438f-96d7-118b40ad6dda None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:39.656241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eca2e3-4ebc-438f-96d7-118b40ad6dda None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:39.658259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 695/1358] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 19:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:39.664013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c783d-bf76-4eca-8063-7b0ac880008e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:39.664307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c783d-bf76-4eca-8063-7b0ac880008e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:39.664593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c783d-bf76-4eca-8063-7b0ac880008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:39.712456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-140c783d-bf76-4eca-8063-7b0ac880008e None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:39.713741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-140c783d-bf76-4eca-8063-7b0ac880008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:39.808535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 664/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:48:39.817199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca2e3-4ebc-438f-96d7-118b40ad6dda None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:39.832152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eca2e3-4ebc-438f-96d7-118b40ad6dda None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:39.837753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:39.838542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:39.838922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:39.839289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:39.848015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:39.849734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75468bc3-b68c-4fc2-88ba-d7b7cfd91258 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:39.859419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 696/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:42.305053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137020f7-aaba-4a91-8335-1e7170be2f22 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:42.305575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137020f7-aaba-4a91-8335-1e7170be2f22 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:42.305654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137020f7-aaba-4a91-8335-1e7170be2f22 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:42.307024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 665/1361] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:42.312737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417e61-ab84-4555-8c10-d1889f3939df None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:42.313526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417e61-ab84-4555-8c10-d1889f3939df None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:42.313810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1417e61-ab84-4555-8c10-d1889f3939df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:42.332384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f1417e61-ab84-4555-8c10-d1889f3939df None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:42.333763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f1417e61-ab84-4555-8c10-d1889f3939df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:42.354925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 697/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:42.395641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137020f7-aaba-4a91-8335-1e7170be2f22 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:42.411529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137020f7-aaba-4a91-8335-1e7170be2f22 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:42.418093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:42.418915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:42.419273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:42.419652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:42.428520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:42.430305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f83549-d8ff-4816-9a1e-6209d51e39c6 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:42.440720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 666/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:45.007201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65f9c-6cbf-4278-a803-06724936bcbc None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:45.007668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65f9c-6cbf-4278-a803-06724936bcbc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:45.007763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65f9c-6cbf-4278-a803-06724936bcbc None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:45.009143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 698/1364] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:45.014382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598eb2-aa10-4447-bd64-72229a6d30eb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:45.014860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598eb2-aa10-4447-bd64-72229a6d30eb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:45.014981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598eb2-aa10-4447-bd64-72229a6d30eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:45.034117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3c598eb2-aa10-4447-bd64-72229a6d30eb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:45.035342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3c598eb2-aa10-4447-bd64-72229a6d30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:45.043485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 667/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:45.090754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165e1c-01aa-4bb5-bd23-fa328034fcb2 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:45.091417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165e1c-01aa-4bb5-bd23-fa328034fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:45.091917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae165e1c-01aa-4bb5-bd23-fa328034fcb2 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:45.093546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 699/1366] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 19:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:45.101051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7cef-a877-4be5-8d6e-057a4cea5cc4 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:45.101309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7cef-a877-4be5-8d6e-057a4cea5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:45.101523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7cef-a877-4be5-8d6e-057a4cea5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:45.120353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1e9b7cef-a877-4be5-8d6e-057a4cea5cc4 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:45.122201 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1e9b7cef-a877-4be5-8d6e-057a4cea5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:45.133105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 668/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 19:48:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:48:45.140785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae165e1c-01aa-4bb5-bd23-fa328034fcb2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:45.155772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae165e1c-01aa-4bb5-bd23-fa328034fcb2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:45.161385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:45.162033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:45.162304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:45.162609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:45.170812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:45.172423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18b8f2-d6a9-423d-9133-a314d8e791af service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:45.182256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 700/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:47.493288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68c73-b87d-4b9f-87c4-d8f7510b1816 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:47.493857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68c73-b87d-4b9f-87c4-d8f7510b1816 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:47.493857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68c73-b87d-4b9f-87c4-d8f7510b1816 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:47.495250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 669/1369] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:47.500713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43d8d-fae6-4420-a146-3567059034b3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:47.501192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43d8d-fae6-4420-a146-3567059034b3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:47.501289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43d8d-fae6-4420-a146-3567059034b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:47.521774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b4a43d8d-fae6-4420-a146-3567059034b3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:47.523700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b4a43d8d-fae6-4420-a146-3567059034b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:47.535905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 701/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:47.579493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68c73-b87d-4b9f-87c4-d8f7510b1816 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:47.595330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68c73-b87d-4b9f-87c4-d8f7510b1816 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:47.601946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:47.602771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:47.603118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:47.603467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:47.615138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:47.617292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b901c-88f7-4201-a71f-6590b2f36be3 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:47.629906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 670/1371] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:47.802263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae4f1-4de3-4dc3-bca9-a11f0efa5b0b None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:47.802674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae4f1-4de3-4dc3-bca9-a11f0efa5b0b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:47.802870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae4f1-4de3-4dc3-bca9-a11f0efa5b0b None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:47.804355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 702/1372] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:47.810382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86b9c-52de-4a75-a7da-953f706d4943 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:47.810785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86b9c-52de-4a75-a7da-953f706d4943 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:47.810986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86b9c-52de-4a75-a7da-953f706d4943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:47.831128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-97a86b9c-52de-4a75-a7da-953f706d4943 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:47.832366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-97a86b9c-52de-4a75-a7da-953f706d4943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:47.841935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 671/1373] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:48.160320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0057-0609-4931-9dde-242c3c056efd None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:48.160320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0057-0609-4931-9dde-242c3c056efd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:48.160320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0057-0609-4931-9dde-242c3c056efd None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:48.164682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 703/1374] 10.222.0.57 () {54 vars in 963 bytes} [Tue May 10 19:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:48.166726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987fbe-5874-48d4-b21b-94ee7061df08 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:48.167027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987fbe-5874-48d4-b21b-94ee7061df08 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:48.167314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59987fbe-5874-48d4-b21b-94ee7061df08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:48.216229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-59987fbe-5874-48d4-b21b-94ee7061df08 None None] MFA Rules not processed for user `34dcdccc1deb40478957efe9bf78dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:48.217440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-59987fbe-5874-48d4-b21b-94ee7061df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:48.279848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 672/1375] 10.222.0.57 () {58 vars in 1060 bytes} [Tue May 10 19:48:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:48.288157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0057-0609-4931-9dde-242c3c056efd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:48.299322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0057-0609-4931-9dde-242c3c056efd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:48.302815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:48.303467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:48.303874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:48.304351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:48.314263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:48.315767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458398e-0ed6-4efc-a417-3849e64e624a service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:48.325246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 704/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:49.961306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3800ae0-e2fe-40f1-9eee-1ee74273a8d1 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:49.962212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3800ae0-e2fe-40f1-9eee-1ee74273a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:49.962683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3800ae0-e2fe-40f1-9eee-1ee74273a8d1 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:49.964338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 673/1377] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:49.970044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf8ac-5283-4c37-8693-8528be1382fd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:49.970587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf8ac-5283-4c37-8693-8528be1382fd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:49.970696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cf8ac-5283-4c37-8693-8528be1382fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:49.989005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-278cf8ac-5283-4c37-8693-8528be1382fd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:49.990252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-278cf8ac-5283-4c37-8693-8528be1382fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:49.999040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 705/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:50.044303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3800ae0-e2fe-40f1-9eee-1ee74273a8d1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:50.058666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3800ae0-e2fe-40f1-9eee-1ee74273a8d1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:50.066023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:50.066715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:50.066999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:50.067278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:50.076175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:50.078224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a7f03-a7a0-4437-bd23-f4357e3d9aba service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:50.090083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 674/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:52.396994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8e5c-ea53-4935-b067-109099852178 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:52.397644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8e5c-ea53-4935-b067-109099852178 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:52.397644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8e5c-ea53-4935-b067-109099852178 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:52.398956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 706/1380] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:48:52.404124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318b25-9718-4c31-bf06-933317c24937 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:52.404560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318b25-9718-4c31-bf06-933317c24937 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:52.404694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318b25-9718-4c31-bf06-933317c24937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:52.423424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-20318b25-9718-4c31-bf06-933317c24937 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:52.424616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-20318b25-9718-4c31-bf06-933317c24937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:52.432697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 675/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:52.476045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8e5c-ea53-4935-b067-109099852178 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:52.490993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8e5c-ea53-4935-b067-109099852178 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:52.496879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:52.497522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:52.497811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:52.498088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:52.507588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:52.509095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc438f21-dd07-4ea5-b84d-dba5f35c6a39 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:52.519650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 707/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:48:54.803496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460428b-66ba-4da2-beae-9fbe872c8f36 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:54.804119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460428b-66ba-4da2-beae-9fbe872c8f36 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:54.804119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460428b-66ba-4da2-beae-9fbe872c8f36 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:54.805736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 676/1383] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:48:54.811995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ba7-feb7-43db-8377-b6b4d221651c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:54.812575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ba7-feb7-43db-8377-b6b4d221651c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:54.812575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ba7-feb7-43db-8377-b6b4d221651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:54.833916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bf3a7ba7-feb7-43db-8377-b6b4d221651c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:54.835432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bf3a7ba7-feb7-43db-8377-b6b4d221651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:54.844310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 708/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:54.886177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460428b-66ba-4da2-beae-9fbe872c8f36 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:54.900916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460428b-66ba-4da2-beae-9fbe872c8f36 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:54.906826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:54.908020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:54.908751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:54.909406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:54.920019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:54.921830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe4ad-a27d-4bcb-b31a-39df914cd402 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:54.933239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 677/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:48:57.203459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c4bb-348f-49c4-966f-5c2099b70fc5 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:57.204019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c4bb-348f-49c4-966f-5c2099b70fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:57.204618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c4bb-348f-49c4-966f-5c2099b70fc5 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:57.206006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 709/1386] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:48:57.211717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11852d-262b-43fd-9090-1fa792b43cc5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:57.212307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11852d-262b-43fd-9090-1fa792b43cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:57.212307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11852d-262b-43fd-9090-1fa792b43cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:57.230219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3b11852d-262b-43fd-9090-1fa792b43cc5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:48:57.231444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3b11852d-262b-43fd-9090-1fa792b43cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:48:57.239887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 678/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:48:57.283911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c4bb-348f-49c4-966f-5c2099b70fc5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:48:57.298847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c4bb-348f-49c4-966f-5c2099b70fc5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:48:57.305955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:48:57.307061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:48:57.307695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:48:57.308304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:48:57.319397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:48:57.321533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aafb9-a80d-471a-bb56-7303a227e2db service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:48:57.334915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 710/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:49:00.217229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea66e-9dcc-4e77-8941-ff85b78bbf43 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:00.217808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea66e-9dcc-4e77-8941-ff85b78bbf43 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:00.218008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea66e-9dcc-4e77-8941-ff85b78bbf43 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:00.219838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 679/1389] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:00.225460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c587-cdbe-4ee4-882b-bf2376ffb658 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:00.225879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c587-cdbe-4ee4-882b-bf2376ffb658 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:00.226129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c587-cdbe-4ee4-882b-bf2376ffb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:00.245134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fa31c587-cdbe-4ee4-882b-bf2376ffb658 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:00.246428 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fa31c587-cdbe-4ee4-882b-bf2376ffb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:00.255593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 711/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:00.300567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea66e-9dcc-4e77-8941-ff85b78bbf43 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:00.315248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea66e-9dcc-4e77-8941-ff85b78bbf43 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:00.320705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:00.321346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:00.321632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:00.321912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:00.330783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:00.332367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0853155-1ad7-47b9-bf7a-99b3f62f6c6b service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:00.342128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 680/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:02.618720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d6af-68da-4fa2-a36b-0f164280d8c7 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:02.619318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d6af-68da-4fa2-a36b-0f164280d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:02.619318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d6af-68da-4fa2-a36b-0f164280d8c7 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:02.620855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 712/1392] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:02.626015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d55d-6b90-461a-9a3a-62d6307c68a5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:02.627052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d55d-6b90-461a-9a3a-62d6307c68a5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:02.627175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d55d-6b90-461a-9a3a-62d6307c68a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:02.644706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0b48d55d-6b90-461a-9a3a-62d6307c68a5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:02.645905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0b48d55d-6b90-461a-9a3a-62d6307c68a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:02.653894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 681/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:02.698295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d6af-68da-4fa2-a36b-0f164280d8c7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:02.713160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d6af-68da-4fa2-a36b-0f164280d8c7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:02.718674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:02.719303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:02.719616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:02.719935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:02.728476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:02.730093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e8a07-d8ee-40d5-8b76-4e6d747c1b29 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:02.740145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 713/1394] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:04.047354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886e1-5917-45dd-a590-c26f86fbd235 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.047924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886e1-5917-45dd-a590-c26f86fbd235 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.047924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455886e1-5917-45dd-a590-c26f86fbd235 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.049802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 682/1395] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:04.055383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8d7e-4e43-4670-aca4-b0cc7e469a8d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.055800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8d7e-4e43-4670-aca4-b0cc7e469a8d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.055951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8d7e-4e43-4670-aca4-b0cc7e469a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.074138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-109d8d7e-4e43-4670-aca4-b0cc7e469a8d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:04.075362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-109d8d7e-4e43-4670-aca4-b0cc7e469a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:04.084093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 714/1396] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:04.141994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575f88-1101-4c0e-adfd-e916ccf8581d None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.142288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575f88-1101-4c0e-adfd-e916ccf8581d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.142599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575f88-1101-4c0e-adfd-e916ccf8581d None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.143994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 683/1397] 10.222.0.57 () {54 vars in 962 bytes} [Tue May 10 19:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:04.149322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f793c-6fc2-4ef7-96cb-8512ecfdc78d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.149608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f793c-6fc2-4ef7-96cb-8512ecfdc78d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.149883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f793c-6fc2-4ef7-96cb-8512ecfdc78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.197081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a08f793c-6fc2-4ef7-96cb-8512ecfdc78d None None] MFA Rules not processed for user `488a9120fefb464f9c9ff8faeb3f8668`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:04.198256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a08f793c-6fc2-4ef7-96cb-8512ecfdc78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:04.256880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 715/1398] 10.222.0.57 () {58 vars in 1059 bytes} [Tue May 10 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:04.264300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d575f88-1101-4c0e-adfd-e916ccf8581d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:04.275107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d575f88-1101-4c0e-adfd-e916ccf8581d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:04.278872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:04.279498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.279781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.280054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.288876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:04.290304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd0101-8cfb-43ec-b3dc-f8db7e5452bd service glance] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:04.299924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 684/1399] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:04.724692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463076-9e60-4a38-bee1-0a57160eac55 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.724986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463076-9e60-4a38-bee1-0a57160eac55 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.725292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463076-9e60-4a38-bee1-0a57160eac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.771648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5a463076-9e60-4a38-bee1-0a57160eac55 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:04.772842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5a463076-9e60-4a38-bee1-0a57160eac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:04.839612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 716/1400] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:04.884770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8006d-2350-43aa-88e2-b3c80a610d70 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.885095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8006d-2350-43aa-88e2-b3c80a610d70 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.885382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8006d-2350-43aa-88e2-b3c80a610d70 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.886809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 685/1401] 10.222.0.57 () {54 vars in 942 bytes} [Tue May 10 19:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:04.892994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.893357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.893666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.941589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] MFA Rules not processed for user `983fe7993d594683afbc43f4a95885a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:04.942813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:04.997006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8073b6-cd88-4677-90d1-655415dd7542 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:04.997306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8073b6-cd88-4677-90d1-655415dd7542 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:04.997590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8073b6-cd88-4677-90d1-655415dd7542 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:04.998992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 686/1402] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:49:05.004655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55009704-4784-417f-8383-00c4d230d01b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:05.005024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55009704-4784-417f-8383-00c4d230d01b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:05.005376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55009704-4784-417f-8383-00c4d230d01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:05.013100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 717/1403] 10.222.0.57 () {58 vars in 1039 bytes} [Tue May 10 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:05.023336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:05.024347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-55009704-4784-417f-8383-00c4d230d01b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:05.025559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-55009704-4784-417f-8383-00c4d230d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:05.032705 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0863c4-9e39-4322-879b-f1bdb617cc85 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:05.033658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 687/1404] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:05.039244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:05.040232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:05.040522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:05.040805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:05.049276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:05.050932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec33e4-cbec-4eca-8b3c-bfcc53eea196 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:05.058874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 718/1405] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 19:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 19:49:05.076487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55009704-4784-417f-8383-00c4d230d01b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:05.092047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55009704-4784-417f-8383-00c4d230d01b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:05.098644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:05.099301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:05.099590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:05.099867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:05.108958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:05.110789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea8e0d-9bd5-442a-8eb2-4980bdb05f1d service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:05.121563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 688/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:49:07.463823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193337-22b9-41a5-932b-09441e2d3141 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:07.464699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193337-22b9-41a5-932b-09441e2d3141 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:07.465115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193337-22b9-41a5-932b-09441e2d3141 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:07.473036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 719/1407] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:49:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:07.473426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e60a-f9d4-4144-819d-d802ee62eb3e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:07.474200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e60a-f9d4-4144-819d-d802ee62eb3e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:07.474491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e60a-f9d4-4144-819d-d802ee62eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:07.494081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2005e60a-f9d4-4144-819d-d802ee62eb3e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:07.495693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2005e60a-f9d4-4144-819d-d802ee62eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:07.504941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 689/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:07.552014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193337-22b9-41a5-932b-09441e2d3141 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:07.576737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193337-22b9-41a5-932b-09441e2d3141 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:07.582854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:07.583511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:07.583801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:07.584083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:07.592495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:07.594104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97651708-0452-4fd9-9b75-07e55f9ad7fa service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:07.603886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 720/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:28.673456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784596b3-f9f9-4d6d-a891-0453b6750e3a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:28.674424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784596b3-f9f9-4d6d-a891-0453b6750e3a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:28.674424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784596b3-f9f9-4d6d-a891-0453b6750e3a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:28.675464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 690/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue May 10 19:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:28.680771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5270-b7f0-4b5d-bffd-d80c6fbd36c7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:28.681242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5270-b7f0-4b5d-bffd-d80c6fbd36c7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:28.681349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5270-b7f0-4b5d-bffd-d80c6fbd36c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:28.699045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-418f5270-b7f0-4b5d-bffd-d80c6fbd36c7 None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:28.700245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-418f5270-b7f0-4b5d-bffd-d80c6fbd36c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:28.709220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 721/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:28.723916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa2bc-2e7e-4a24-9e98-c7a2ae3c2232 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:28.724272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa2bc-2e7e-4a24-9e98-c7a2ae3c2232 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:28.724560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa2bc-2e7e-4a24-9e98-c7a2ae3c2232 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:28.725916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 691/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue May 10 19:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:28.730355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa49f-2a7f-4b0c-b550-e0b6bf79e113 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:28.730673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa49f-2a7f-4b0c-b550-e0b6bf79e113 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:28.730952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fa49f-2a7f-4b0c-b550-e0b6bf79e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:28.749312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6a1fa49f-2a7f-4b0c-b550-e0b6bf79e113 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:28.750578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6a1fa49f-2a7f-4b0c-b550-e0b6bf79e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:28.759597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 722/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue May 10 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:31.471569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec076-5073-41fa-b827-2ca1fc5d2587 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:31.472160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec076-5073-41fa-b827-2ca1fc5d2587 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:31.472160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cec076-5073-41fa-b827-2ca1fc5d2587 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:31.473489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 692/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:31.478723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e28c-108a-4844-ac14-e17d7c6021be None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:31.479158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e28c-108a-4844-ac14-e17d7c6021be None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:31.479293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1e28c-108a-4844-ac14-e17d7c6021be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:31.497702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2ec1e28c-108a-4844-ac14-e17d7c6021be None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:31.498934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2ec1e28c-108a-4844-ac14-e17d7c6021be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:31.506642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 723/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:31.548151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cec076-5073-41fa-b827-2ca1fc5d2587 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:31.562189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cec076-5073-41fa-b827-2ca1fc5d2587 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:31.567593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:31.568218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:31.568500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:31.568775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:31.576600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:31.578171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6ddc5-3c0e-49f5-bde4-f3d38b15bbb3 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:31.587769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 693/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:32.581266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763de0-28f9-438b-852c-b83644aa5777 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:32.581796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763de0-28f9-438b-852c-b83644aa5777 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:32.581895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763de0-28f9-438b-852c-b83644aa5777 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:32.583388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 724/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:49:32.588649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dabd59-4214-4e35-a190-5dbb6b6a30dc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:32.589084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dabd59-4214-4e35-a190-5dbb6b6a30dc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:32.589179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dabd59-4214-4e35-a190-5dbb6b6a30dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:32.607138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-92dabd59-4214-4e35-a190-5dbb6b6a30dc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:32.608330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-92dabd59-4214-4e35-a190-5dbb6b6a30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:32.616009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 694/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:32.775667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c763de0-28f9-438b-852c-b83644aa5777 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:32.789845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c763de0-28f9-438b-852c-b83644aa5777 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:32.795113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:32.795742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:32.796033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:32.796308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:32.804455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:32.806034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f6fd7-d61c-4734-80ff-92734a082980 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:32.815749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 725/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:33.772837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980701a-d4a5-4839-b1b5-bfbb70882601 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:33.773408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980701a-d4a5-4839-b1b5-bfbb70882601 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:33.773408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980701a-d4a5-4839-b1b5-bfbb70882601 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:33.774844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 695/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:33.780012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ddf00-ae4a-422c-837b-17e13115b1cd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:33.780419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ddf00-ae4a-422c-837b-17e13115b1cd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:33.780627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ddf00-ae4a-422c-837b-17e13115b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:33.798237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-861ddf00-ae4a-422c-837b-17e13115b1cd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:33.799993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-861ddf00-ae4a-422c-837b-17e13115b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:33.807614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 726/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:33.959707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980701a-d4a5-4839-b1b5-bfbb70882601 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:33.976987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980701a-d4a5-4839-b1b5-bfbb70882601 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:33.983943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:33.984573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:33.984852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:33.985121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:33.994277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:33.996162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52498a-2783-470d-a79b-a9c5d6d8918e service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:34.005276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 696/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:34.942709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51362-0325-4d7d-8574-d7be64facd4d None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:34.943242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51362-0325-4d7d-8574-d7be64facd4d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:34.943242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51362-0325-4d7d-8574-d7be64facd4d None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:34.944560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 727/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:34.949605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167cc-6901-43e5-8b0b-33fc76ac13f7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:34.950044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167cc-6901-43e5-8b0b-33fc76ac13f7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:34.950138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167cc-6901-43e5-8b0b-33fc76ac13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:34.968068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-04e167cc-6901-43e5-8b0b-33fc76ac13f7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:34.969278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-04e167cc-6901-43e5-8b0b-33fc76ac13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:34.976980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 697/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:35.126743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51362-0325-4d7d-8574-d7be64facd4d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:35.141922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51362-0325-4d7d-8574-d7be64facd4d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:35.148249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:35.148884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:35.149169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:35.149446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:35.157433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:35.159173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034513c-abcf-4776-90b1-a7e25a3a849f service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:35.168449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 728/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:36.100395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc756e-10fd-4cfa-8344-7418e20fc871 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:36.100952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc756e-10fd-4cfa-8344-7418e20fc871 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:36.100952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc756e-10fd-4cfa-8344-7418e20fc871 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:36.102308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 698/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:36.107396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcb8b3-ff33-43cf-a96a-394f782c0dd1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:36.107829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcb8b3-ff33-43cf-a96a-394f782c0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:36.107961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcb8b3-ff33-43cf-a96a-394f782c0dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:36.126413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3dbcb8b3-ff33-43cf-a96a-394f782c0dd1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:36.128208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3dbcb8b3-ff33-43cf-a96a-394f782c0dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:36.136080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 729/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:36.286689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc756e-10fd-4cfa-8344-7418e20fc871 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:36.301196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc756e-10fd-4cfa-8344-7418e20fc871 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:36.306818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:36.307452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:36.307735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:36.308010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:36.316648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:36.318219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aea72-a927-4d7f-83ab-323ae568516d service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:36.327625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 699/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:37.194489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135797-c5f0-4406-81ed-8a84c0185431 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:37.195069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135797-c5f0-4406-81ed-8a84c0185431 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:37.195174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b135797-c5f0-4406-81ed-8a84c0185431 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:37.196540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 730/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:37.201502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04bd3-0fc5-45b7-a53d-c649dc5c9e0c None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:37.201944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04bd3-0fc5-45b7-a53d-c649dc5c9e0c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:37.202061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04bd3-0fc5-45b7-a53d-c649dc5c9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:37.220194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0da04bd3-0fc5-45b7-a53d-c649dc5c9e0c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:37.221404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0da04bd3-0fc5-45b7-a53d-c649dc5c9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:37.229171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 700/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:37.378279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b135797-c5f0-4406-81ed-8a84c0185431 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:37.394374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b135797-c5f0-4406-81ed-8a84c0185431 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:37.400859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:37.401633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:37.401915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:37.402188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:37.411558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:37.413769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2486c-d275-4fab-b2bf-f87573734044 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:37.424506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 731/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:38.362374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e22ba-665f-4543-a7f5-87a1cd05347d None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:38.362956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e22ba-665f-4543-a7f5-87a1cd05347d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:38.362956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e22ba-665f-4543-a7f5-87a1cd05347d None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:38.364360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 701/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:38.369475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ee2d-b8b5-4205-bee3-1c2b5039aa50 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:38.370164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ee2d-b8b5-4205-bee3-1c2b5039aa50 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:38.370320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3ee2d-b8b5-4205-bee3-1c2b5039aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:38.389423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c7e3ee2d-b8b5-4205-bee3-1c2b5039aa50 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:38.390661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c7e3ee2d-b8b5-4205-bee3-1c2b5039aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:38.398443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 732/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:38.547020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e22ba-665f-4543-a7f5-87a1cd05347d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:38.561665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e22ba-665f-4543-a7f5-87a1cd05347d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:38.567831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:38.568461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:38.568749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:38.569026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:38.576951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:38.578607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291566d5-323d-427b-9a46-fb2a597c4a03 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:38.588363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 702/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:39.448316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d603cc-d875-4b10-8cb3-715c18bb9dbf None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:39.448866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d603cc-d875-4b10-8cb3-715c18bb9dbf None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:39.448866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d603cc-d875-4b10-8cb3-715c18bb9dbf None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:39.450227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 733/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:39.455320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000cc7-a4ca-415b-bb0c-3d9bddc478c7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:39.456207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000cc7-a4ca-415b-bb0c-3d9bddc478c7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:39.456373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000cc7-a4ca-415b-bb0c-3d9bddc478c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:39.474337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e2000cc7-a4ca-415b-bb0c-3d9bddc478c7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:39.475559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e2000cc7-a4ca-415b-bb0c-3d9bddc478c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:39.483203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 703/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:39.631317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d603cc-d875-4b10-8cb3-715c18bb9dbf None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:39.645514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d603cc-d875-4b10-8cb3-715c18bb9dbf None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:39.650871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:39.651497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:39.651779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:39.652053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:39.660445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:39.662011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e4ddc-8d63-416a-a435-a6c6382e7bd8 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:39.671190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 734/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:40.536743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45243-6a53-4999-90f1-3cd3193095d6 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:40.537181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45243-6a53-4999-90f1-3cd3193095d6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:40.537305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb45243-6a53-4999-90f1-3cd3193095d6 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:40.538735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 704/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:40.543659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39388d-2e9a-4191-b5b5-c7b52d8b8959 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:40.544071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39388d-2e9a-4191-b5b5-c7b52d8b8959 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:40.544206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39388d-2e9a-4191-b5b5-c7b52d8b8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:40.561943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fd39388d-2e9a-4191-b5b5-c7b52d8b8959 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:40.563146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fd39388d-2e9a-4191-b5b5-c7b52d8b8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:40.571339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 735/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:40.719135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb45243-6a53-4999-90f1-3cd3193095d6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:40.732982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb45243-6a53-4999-90f1-3cd3193095d6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:40.738851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:40.739476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:40.739757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:40.740032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:40.754119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:40.755954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d657926-ac63-4284-85dd-1424f5979157 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:40.765617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 705/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:42.861251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402e1-db8b-4bd6-ba46-d4f9aba2da28 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:42.862309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402e1-db8b-4bd6-ba46-d4f9aba2da28 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:42.862397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c402e1-db8b-4bd6-ba46-d4f9aba2da28 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:42.863760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 736/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:42.869232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48454e-6cf6-44ab-b3c0-81c1dada99e0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:42.869618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48454e-6cf6-44ab-b3c0-81c1dada99e0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:42.869789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48454e-6cf6-44ab-b3c0-81c1dada99e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:42.887842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1f48454e-6cf6-44ab-b3c0-81c1dada99e0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:42.889038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1f48454e-6cf6-44ab-b3c0-81c1dada99e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:42.896836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 706/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:42.935126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c402e1-db8b-4bd6-ba46-d4f9aba2da28 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:42.946186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c402e1-db8b-4bd6-ba46-d4f9aba2da28 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:42.949688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:42.950315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:42.950636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:42.950913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:42.959997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:42.961397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54874-9f9d-4abd-bc03-abe3fba742f4 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:42.970567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 737/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:45.325347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:45.325847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:45.325961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:45.327313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 707/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:45.333189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091a5b-3f87-458e-a2bf-25ad1c41c9c7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:45.333644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091a5b-3f87-458e-a2bf-25ad1c41c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:45.333754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091a5b-3f87-458e-a2bf-25ad1c41c9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:45.351327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cb091a5b-3f87-458e-a2bf-25ad1c41c9c7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:45.353042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cb091a5b-3f87-458e-a2bf-25ad1c41c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:45.361047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 738/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:45.399398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:45.401072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:45.414335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0889de-844b-45b8-bcc0-c071a0df33ba None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:45.417854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:45.418513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:45.418803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:45.419083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:45.428370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:45.429785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e8465-9c7f-4ac3-ae91-aadb21325685 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:45.438903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 708/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:48.012025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbca0-d112-4f5f-9a90-792a0005ee63 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:48.012542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbca0-d112-4f5f-9a90-792a0005ee63 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:48.012636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccbca0-d112-4f5f-9a90-792a0005ee63 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:48.013954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 739/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:48.019905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9cc4-df3a-450f-aa87-559ce8e36aca None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:48.020363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9cc4-df3a-450f-aa87-559ce8e36aca None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:48.020472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9cc4-df3a-450f-aa87-559ce8e36aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:48.037793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a10c9cc4-df3a-450f-aa87-559ce8e36aca None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:48.038964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a10c9cc4-df3a-450f-aa87-559ce8e36aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:48.046754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 709/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:48.084684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccbca0-d112-4f5f-9a90-792a0005ee63 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:48.095363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccbca0-d112-4f5f-9a90-792a0005ee63 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:48.098915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:48.099546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:48.099827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:48.100100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:48.108724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:48.110155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c760eb0-b6ec-4c67-8a37-444100e08fdc service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:48.119845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 740/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:50.449104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4486-16c6-4f46-b7ad-1851a22482f4 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:50.449700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4486-16c6-4f46-b7ad-1851a22482f4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:50.449700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4486-16c6-4f46-b7ad-1851a22482f4 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:50.451070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 710/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:50.456638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47080-1ec7-492e-a38a-e85762c0350c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:50.457082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47080-1ec7-492e-a38a-e85762c0350c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:50.457190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47080-1ec7-492e-a38a-e85762c0350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:50.474313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fdb47080-1ec7-492e-a38a-e85762c0350c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:50.475514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fdb47080-1ec7-492e-a38a-e85762c0350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:50.483164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 741/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:50.522193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4486-16c6-4f46-b7ad-1851a22482f4 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:50.532734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4486-16c6-4f46-b7ad-1851a22482f4 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:50.537266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:50.537902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:50.538189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:50.538482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:50.547351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:50.548777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6df24-e14b-4c4f-b40d-0317ee875ec0 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:50.557981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 711/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:52.886960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3610-cda0-4381-85e3-ad8a95f6541a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:52.887485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3610-cda0-4381-85e3-ad8a95f6541a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:52.887485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f3610-cda0-4381-85e3-ad8a95f6541a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:52.888817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 742/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:52.894968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acaca-b3ca-40d4-9de7-fdca269e08f2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:52.895651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acaca-b3ca-40d4-9de7-fdca269e08f2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:52.895651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acaca-b3ca-40d4-9de7-fdca269e08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:52.913741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-894acaca-b3ca-40d4-9de7-fdca269e08f2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:52.914965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-894acaca-b3ca-40d4-9de7-fdca269e08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:52.922664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 712/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:49:52.959498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f3610-cda0-4381-85e3-ad8a95f6541a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:52.969933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f3610-cda0-4381-85e3-ad8a95f6541a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:52.973927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:52.974588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:52.974876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:52.975153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:52.983756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:52.985221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041b026-65b5-416b-ac9f-d712c7bb1cef service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:52.994975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 743/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:49:55.312719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79575276-bff6-44ff-ab29-82fa2a2ff042 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:55.313280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79575276-bff6-44ff-ab29-82fa2a2ff042 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:55.313280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79575276-bff6-44ff-ab29-82fa2a2ff042 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:55.314691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 713/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:55.320509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a56f-cc1a-4ee1-9e27-471f00ebf002 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:55.320920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a56f-cc1a-4ee1-9e27-471f00ebf002 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:55.321079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9a56f-cc1a-4ee1-9e27-471f00ebf002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:55.340322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-30f9a56f-cc1a-4ee1-9e27-471f00ebf002 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:55.341542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-30f9a56f-cc1a-4ee1-9e27-471f00ebf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:55.349403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 744/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:55.388170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79575276-bff6-44ff-ab29-82fa2a2ff042 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:55.398768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79575276-bff6-44ff-ab29-82fa2a2ff042 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:55.402265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:55.402924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:55.403216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:55.403492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:55.412564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:55.413995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8dae-4c8b-476e-bc16-58f82f304752 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:55.423090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 714/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:49:57.709076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c9e9-36bf-4a3b-b3b0-fe10731e560c None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:57.709633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c9e9-36bf-4a3b-b3b0-fe10731e560c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:57.709633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c9e9-36bf-4a3b-b3b0-fe10731e560c None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:57.711106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 745/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:49:57.716506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fa61-aaeb-4acd-8631-63323f7f31a2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:57.716953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fa61-aaeb-4acd-8631-63323f7f31a2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:57.717081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fa61-aaeb-4acd-8631-63323f7f31a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:57.734821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2b94fa61-aaeb-4acd-8631-63323f7f31a2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:49:57.736014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2b94fa61-aaeb-4acd-8631-63323f7f31a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:49:57.744255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 715/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:49:57.781183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c9e9-36bf-4a3b-b3b0-fe10731e560c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:49:57.792314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c9e9-36bf-4a3b-b3b0-fe10731e560c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:49:57.795846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:49:57.796475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:49:57.796762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:49:57.797045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:49:57.806249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:49:57.807752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f65e9a-b8db-4df9-92c5-fa3dba1f6905 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:49:57.817142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 746/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:00.099165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07604a-c9dc-407c-8c8f-07448d89a8ab None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:00.099686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07604a-c9dc-407c-8c8f-07448d89a8ab None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:00.099686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07604a-c9dc-407c-8c8f-07448d89a8ab None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:00.101025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 716/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:00.106420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1455a1-c011-46f8-98e6-c2f3b752fefb None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:00.106876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1455a1-c011-46f8-98e6-c2f3b752fefb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:00.107016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1455a1-c011-46f8-98e6-c2f3b752fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:00.125190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5c1455a1-c011-46f8-98e6-c2f3b752fefb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:00.126392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5c1455a1-c011-46f8-98e6-c2f3b752fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:00.134850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 747/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:00.170663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07604a-c9dc-407c-8c8f-07448d89a8ab None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:00.181585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07604a-c9dc-407c-8c8f-07448d89a8ab None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:00.185096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:00.185713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:00.185995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:00.186270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:00.195630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:00.197044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13ff9b-5842-478e-b374-647ad19c1fda service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:00.206802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 717/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:02.437155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bd0e-6811-4785-b742-7574cf935268 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:02.437726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bd0e-6811-4785-b742-7574cf935268 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:02.437836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658bd0e-6811-4785-b742-7574cf935268 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:02.439155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 748/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:02.445417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93d53f-2260-451b-9dae-d8e2ef636084 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:02.445861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93d53f-2260-451b-9dae-d8e2ef636084 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:02.446018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93d53f-2260-451b-9dae-d8e2ef636084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:02.463256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-ca93d53f-2260-451b-9dae-d8e2ef636084 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:02.464518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ca93d53f-2260-451b-9dae-d8e2ef636084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:02.472667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 718/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:02.508941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bd0e-6811-4785-b742-7574cf935268 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:02.519502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658bd0e-6811-4785-b742-7574cf935268 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:02.523069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:02.523701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:02.523986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:02.524259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:02.533504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:02.535084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee5a96-d46a-4188-a312-838fc788787e service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:02.544641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 749/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:04.769297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c901a-e9a1-4ea5-8c4e-83f4ea4521c1 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:04.769853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c901a-e9a1-4ea5-8c4e-83f4ea4521c1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:04.769964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c901a-e9a1-4ea5-8c4e-83f4ea4521c1 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:04.771321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 719/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:04.776773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735c82-8642-47c9-9a2d-79b212f3082b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:04.777176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735c82-8642-47c9-9a2d-79b212f3082b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:04.777281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735c82-8642-47c9-9a2d-79b212f3082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:04.795405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cc735c82-8642-47c9-9a2d-79b212f3082b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:04.796609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cc735c82-8642-47c9-9a2d-79b212f3082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:04.804775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 750/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:04.840729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c901a-e9a1-4ea5-8c4e-83f4ea4521c1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:04.851767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c901a-e9a1-4ea5-8c4e-83f4ea4521c1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:04.855257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:04.855880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:04.856172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:04.856448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:04.865543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:04.867014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233a675-06a9-4349-8c90-4f9cce249e03 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:04.876756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 720/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:37.984255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44016c-604e-4ef2-ac50-991bbe645f49 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:37.984863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44016c-604e-4ef2-ac50-991bbe645f49 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:37.984863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44016c-604e-4ef2-ac50-991bbe645f49 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:37.986173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 751/1471] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:37.992824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6166b-cfd5-4492-80ea-905bfebf9730 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:37.993273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6166b-cfd5-4492-80ea-905bfebf9730 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:37.993377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6166b-cfd5-4492-80ea-905bfebf9730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:38.011931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0aa6166b-cfd5-4492-80ea-905bfebf9730 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:38.013133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0aa6166b-cfd5-4492-80ea-905bfebf9730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:38.021167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 721/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:38.067627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014815-4926-403a-b325-63daa74440a6 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:38.067855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014815-4926-403a-b325-63daa74440a6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:38.068127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da014815-4926-403a-b325-63daa74440a6 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:38.069476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 752/1473] 10.222.0.57 () {54 vars in 962 bytes} [Tue May 10 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:38.074136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5f7f-575f-428b-9cad-ca6b8e38fbae None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:38.074427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5f7f-575f-428b-9cad-ca6b8e38fbae None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:38.074739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5f7f-575f-428b-9cad-ca6b8e38fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:38.093139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-717f5f7f-575f-428b-9cad-ca6b8e38fbae None None] MFA Rules not processed for user `488a9120fefb464f9c9ff8faeb3f8668`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:38.094359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-717f5f7f-575f-428b-9cad-ca6b8e38fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:38.101518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 722/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Tue May 10 19:50:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:38.108874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da014815-4926-403a-b325-63daa74440a6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:38.119575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da014815-4926-403a-b325-63daa74440a6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:38.123419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:38.124046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:38.124331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:38.124610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:38.133950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:38.135415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb7a34-d981-4253-8949-01695c9d2922 service glance] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:38.145224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 753/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:50:40.477054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c62cd-1bca-4b5c-aab3-05057bfa8c5c None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:40.477623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c62cd-1bca-4b5c-aab3-05057bfa8c5c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:40.477623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c62cd-1bca-4b5c-aab3-05057bfa8c5c None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:40.479033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 723/1476] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:40.484282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7cbb-eaef-494f-995b-09f0496ce289 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:40.484722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7cbb-eaef-494f-995b-09f0496ce289 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:40.484855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7cbb-eaef-494f-995b-09f0496ce289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:40.503188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-208d7cbb-eaef-494f-995b-09f0496ce289 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:40.504376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-208d7cbb-eaef-494f-995b-09f0496ce289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:40.512402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 754/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:40.536407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c62cd-1bca-4b5c-aab3-05057bfa8c5c None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:40.548593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c62cd-1bca-4b5c-aab3-05057bfa8c5c None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:40.553085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:40.553719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:40.554000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:40.554272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:40.555034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:40.556820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:50:40.556820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:50:40.556820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:50:40.557960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1ea3-666a-4371-aeec-bcac9448f38c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:40.576738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 724/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue May 10 19:50:40 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:50:42.795282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da0c8-cae8-4fb0-9382-4f085fa3ea99 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:42.795826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da0c8-cae8-4fb0-9382-4f085fa3ea99 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:42.795826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da0c8-cae8-4fb0-9382-4f085fa3ea99 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:42.797226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 755/1479] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:42.802618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4ee9-0ec8-4d68-b178-eda6c0d04247 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:42.803040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4ee9-0ec8-4d68-b178-eda6c0d04247 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:42.803180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd4ee9-0ec8-4d68-b178-eda6c0d04247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:42.820495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-03bd4ee9-0ec8-4d68-b178-eda6c0d04247 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:42.821695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-03bd4ee9-0ec8-4d68-b178-eda6c0d04247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:42.829615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 725/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:42.871889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da0c8-cae8-4fb0-9382-4f085fa3ea99 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:42.886143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da0c8-cae8-4fb0-9382-4f085fa3ea99 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:42.891555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:42.892179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:42.892466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:42.892746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:42.901132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:42.902776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34928973-0587-42e3-8f4f-8dea5d40bb88 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:42.912817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 756/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:45.329252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c93e5-16a8-4c1f-a843-d61fd847ccd6 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:45.329764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c93e5-16a8-4c1f-a843-d61fd847ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:45.329864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c93e5-16a8-4c1f-a843-d61fd847ccd6 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:45.331818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 726/1482] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:45.338175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83824a-7a26-4d6d-ac9f-d53653fe5fcf None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:45.338857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83824a-7a26-4d6d-ac9f-d53653fe5fcf None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:45.338857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83824a-7a26-4d6d-ac9f-d53653fe5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:45.356521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0c83824a-7a26-4d6d-ac9f-d53653fe5fcf None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:45.357720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0c83824a-7a26-4d6d-ac9f-d53653fe5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:45.365573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 757/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:45.402435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c93e5-16a8-4c1f-a843-d61fd847ccd6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:45.413251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c93e5-16a8-4c1f-a843-d61fd847ccd6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:45.417532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:45.418168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:45.418451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:45.418758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:45.427863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:45.429345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c0fb7-979c-490a-9a9c-7a741bc4b206 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:45.438617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 727/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:47.736273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdf22-ca7e-493b-aa2e-4fc8f863b59a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:47.736835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdf22-ca7e-493b-aa2e-4fc8f863b59a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:47.736835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcdf22-ca7e-493b-aa2e-4fc8f863b59a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:47.738810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 758/1485] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:47.743931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a27437-3785-47b2-aed7-14e98d21b890 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:47.744352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a27437-3785-47b2-aed7-14e98d21b890 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:47.744514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a27437-3785-47b2-aed7-14e98d21b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:47.761947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c4a27437-3785-47b2-aed7-14e98d21b890 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:47.763174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c4a27437-3785-47b2-aed7-14e98d21b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:47.771113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 728/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:47.808769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdf22-ca7e-493b-aa2e-4fc8f863b59a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:47.819167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcdf22-ca7e-493b-aa2e-4fc8f863b59a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:47.822860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:47.823486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:47.823771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:47.824046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:47.832934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:47.834519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f4d22-537b-482c-964b-badeb0429544 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:47.843884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 759/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:50.147918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2dab9-248b-4cde-8dcc-19518cd199a7 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:50.148529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2dab9-248b-4cde-8dcc-19518cd199a7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:50.148529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2dab9-248b-4cde-8dcc-19518cd199a7 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:50.149774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 729/1488] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:50.155127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4db-e602-4e72-ac5d-c90291db8983 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:50.155599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4db-e602-4e72-ac5d-c90291db8983 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:50.155705 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4db-e602-4e72-ac5d-c90291db8983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:50.173671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f567e4db-e602-4e72-ac5d-c90291db8983 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:50.175516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f567e4db-e602-4e72-ac5d-c90291db8983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:50.183369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 760/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:50.223146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2dab9-248b-4cde-8dcc-19518cd199a7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:50.233584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2dab9-248b-4cde-8dcc-19518cd199a7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:50.237612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:50.238243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:50.238557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:50.238837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:50.247566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:50.249239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec9458-1bf8-40cd-855a-fa4283472b6d service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:50.258510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 730/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:50:52.717788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b08e-729a-4114-9850-990bcfd55da5 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:52.718350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b08e-729a-4114-9850-990bcfd55da5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:52.718350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b08e-729a-4114-9850-990bcfd55da5 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:52.719758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 761/1491] 10.222.0.57 () {54 vars in 926 bytes} [Tue May 10 19:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:50:52.725643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d812-6dde-49e9-a2b0-f880e773696b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:52.726074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d812-6dde-49e9-a2b0-f880e773696b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:52.726206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d812-6dde-49e9-a2b0-f880e773696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:52.743639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1b74d812-6dde-49e9-a2b0-f880e773696b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:50:52.744927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1b74d812-6dde-49e9-a2b0-f880e773696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:50:52.752797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 731/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue May 10 19:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:50:52.791315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1b08e-729a-4114-9850-990bcfd55da5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:50:52.801878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1b08e-729a-4114-9850-990bcfd55da5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:50:52.805340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:50:52.805959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:50:52.806239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:50:52.806549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:50:52.815124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:50:52.816673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcb9bc-3a8a-472a-b71f-6b62d4377e14 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:50:52.825663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 762/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:52:20.555523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.556079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.556079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.574185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:52:20.575408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:20.583741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 732/1494] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:52:20.592672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.593239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.593239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.610971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:52:20.612665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:20.620403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 763/1495] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:52:20.625283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.634764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a80b-6625-4ac4-ae7c-0e7398bab34b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.639296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.639936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.640218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.640492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.641207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:52:20.641512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.642578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.642578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:52:20.642578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:52:20.643458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.654650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 733/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:52:20.663210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.672215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96473a6a-066d-4169-b2e4-3e87bf4a8a10 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.677266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.677916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.678203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.678570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.679273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.681022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.681022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:52:20.681022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:52:20.682218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.722186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 764/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:52:20 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:52:20.723375 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.733588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028aa1c-f380-4f79-ab9e-7c10456fbdab admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.790655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.791240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.791523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.791799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.792478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.793485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.793485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:52:20.793485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:52:20.794730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.816062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 734/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:52:20 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:52:20.820443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.830596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267299ec-7b03-45b7-8946-2bcc36a26ca3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.835306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.836003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.836290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.836568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.837295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.838311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.838311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:52:20.838311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:52:20.839255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.856670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 765/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:52:20.861118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.871754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b803-1506-433d-9f57-6d64dd08d52e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.876647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.877302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.877612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.877891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.878647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.879654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.879654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:52:20.879654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:52:20.880579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5297f4-3909-433c-aaa7-42a6e274d064 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.893542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 735/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:52:20.897631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:20.907630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126f88-30e4-44cf-8e1f-71d92e6be952 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:20.912678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:20.913552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.913834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.914138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] PATH_INFO: `/v3/projects/848834e4f2ad4a5fb0620807f7674f5a/users/22417887b3a94a1f8b4d31c3d0237654/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.929813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848834e4f2ad4a5fb0620807f7674f5a, user_id=22417887b3a94a1f8b4d31c3d0237654, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:20.930901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:20.930901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:52:20.930901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:52:20.932822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cde6fa-de3f-4aa6-8c32-9a8ad53a22e8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:20.946085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 766/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:52:20 2022] PUT /identity/v3/projects/848834e4f2ad4a5fb0620807f7674f5a/users/22417887b3a94a1f8b4d31c3d0237654/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:52:20.957200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed854d-8708-43ce-acd1-b7dff46eb259 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:20.957494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed854d-8708-43ce-acd1-b7dff46eb259 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:20.957775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed854d-8708-43ce-acd1-b7dff46eb259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:20.983326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-53ed854d-8708-43ce-acd1-b7dff46eb259 None None] MFA Rules not processed for user `22417887b3a94a1f8b4d31c3d0237654`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:52:20.984543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-53ed854d-8708-43ce-acd1-b7dff46eb259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:21.048853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 736/1502] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:52:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:52:21.062096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff89e7-9f3c-49d1-87ca-7360375e7b4c None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.062535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff89e7-9f3c-49d1-87ca-7360375e7b4c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.062823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff89e7-9f3c-49d1-87ca-7360375e7b4c None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.064203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 767/1503] 10.222.0.57 () {54 vars in 963 bytes} [Tue May 10 19:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:52:21.069135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32262f7-74bb-4950-8f30-1e3b7b343a33 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.069428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32262f7-74bb-4950-8f30-1e3b7b343a33 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.069705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32262f7-74bb-4950-8f30-1e3b7b343a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.088181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c32262f7-74bb-4950-8f30-1e3b7b343a33 None None] MFA Rules not processed for user `34dcdccc1deb40478957efe9bf78dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:52:21.089397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c32262f7-74bb-4950-8f30-1e3b7b343a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:21.142963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 737/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Tue May 10 19:52:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:52:21.150616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff89e7-9f3c-49d1-87ca-7360375e7b4c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:21.161130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff89e7-9f3c-49d1-87ca-7360375e7b4c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:21.164818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:21.165450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.165735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.166011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.174773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:21.176208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:21.184906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 768/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:52:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:52:21.229387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4289d-0ee7-414f-b317-71e1c0f5f0c2 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.229684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4289d-0ee7-414f-b317-71e1c0f5f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.229969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4289d-0ee7-414f-b317-71e1c0f5f0c2 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.231307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 738/1506] 10.222.0.57 () {52 vars in 829 bytes} [Tue May 10 19:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:52:21.235186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:21.294863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45371213-6db4-4263-85f2-9cae7176d4e9 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:21.299950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:21.300737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.301018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.301290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] PATH_INFO: `/v3/users/22417887b3a94a1f8b4d31c3d0237654` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.302502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22417887b3a94a1f8b4d31c3d0237654)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:21.303537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:21.303537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:52:21.303537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:52:21.304740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:21.373035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22417887b3a94a1f8b4d31c3d0237654'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:21.386306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22417887b3a94a1f8b4d31c3d0237654'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:21.396212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22417887b3a94a1f8b4d31c3d0237654'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:21.397081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22417887b3a94a1f8b4d31c3d0237654'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:21.397701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22417887b3a94a1f8b4d31c3d0237654'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:21.421961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 769/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:52:21 2022] DELETE /identity/v3/users/22417887b3a94a1f8b4d31c3d0237654 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:52:21.427017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.427307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.427582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.446132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:52:21.447392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:21.503608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 739/1508] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:52:21.514521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:21.515930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:21.575726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312750ec-88d5-4368-b13f-d38bff224990 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:21.579819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:21.581135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.581506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.581783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.591326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:21.592990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c1916-6594-47dc-9054-95aa8b575403 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:21.602758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 770/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:52:21.922593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:52:21.924646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:52:21.936452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c436-2593-4c0b-8e65-ae307da26633 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:52:21.942934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:52:21.943823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:52:21.944284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:52:21.944654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] PATH_INFO: `/v3/projects/848834e4f2ad4a5fb0620807f7674f5a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:52:21.946911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] RBAC: Authorizing `identity:delete_project(project_id=848834e4f2ad4a5fb0620807f7674f5a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:52:21.948312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:52:21.948312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:52:21.948312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:52:21.949560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:52:22.009427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848834e4f2ad4a5fb0620807f7674f5a', 'request_id': 'req-6db194eb-ce0c-43bb-87d0-42dc32e3755c'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:22.022762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848834e4f2ad4a5fb0620807f7674f5a', 'request_id': 'req-6db194eb-ce0c-43bb-87d0-42dc32e3755c'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:22.032035 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848834e4f2ad4a5fb0620807f7674f5a', 'request_id': 'req-6db194eb-ce0c-43bb-87d0-42dc32e3755c'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:22.042357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] The token cache is being invalidate because project 848834e4f2ad4a5fb0620807f7674f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:52:22.042674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:22.043300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6db194eb-ce0c-43bb-87d0-42dc32e3755c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:52:22.044926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 740/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:52:21 2022] DELETE /identity/v3/projects/848834e4f2ad4a5fb0620807f7674f5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:54:06.069016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:06.070166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:06.070343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:06.071768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 771/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:06.076841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d379e7-7776-454d-b8c9-b8816419717b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:06.077255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d379e7-7776-454d-b8c9-b8816419717b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:06.077398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d379e7-7776-454d-b8c9-b8816419717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:06.095206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f3d379e7-7776-454d-b8c9-b8816419717b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:06.096442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f3d379e7-7776-454d-b8c9-b8816419717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:06.156866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 741/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:06.326508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:06.328250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:06.401532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56dcf-9428-435c-b72f-34c9d8c9416a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:06.407012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69866d24-bd56-4094-a493-47d853602549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:06.407733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866d24-bd56-4094-a493-47d853602549 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:06.408019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866d24-bd56-4094-a493-47d853602549 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:06.408296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69866d24-bd56-4094-a493-47d853602549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:06.416833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69866d24-bd56-4094-a493-47d853602549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:06.418525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69866d24-bd56-4094-a493-47d853602549 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:06.428097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 772/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:07.098169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f395e-569f-4c98-8074-75fbd8e8d33e None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:07.098759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f395e-569f-4c98-8074-75fbd8e8d33e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:07.098852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f395e-569f-4c98-8074-75fbd8e8d33e None None] PATH_INFO: `/v3` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:07.100283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 742/1514] 10.222.0.60 () {54 vars in 925 bytes} [Tue May 10 19:54:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:54:07.106605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882bdc-0380-4067-9ce5-9d4f64652063 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:07.107045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882bdc-0380-4067-9ce5-9d4f64652063 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:07.107215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f882bdc-0380-4067-9ce5-9d4f64652063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:07.126445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2f882bdc-0380-4067-9ce5-9d4f64652063 None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:07.127823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2f882bdc-0380-4067-9ce5-9d4f64652063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:07.189179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 773/1515] 10.222.0.60 () {58 vars in 1015 bytes} [Tue May 10 19:54:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:07.330417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08469-3ac6-45c0-a4fe-e582ca913f7a None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:07.330667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08469-3ac6-45c0-a4fe-e582ca913f7a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:07.330937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b08469-3ac6-45c0-a4fe-e582ca913f7a None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:07.332324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 743/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:07.337797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61b2-f245-4c0d-8ed4-16f66c7a8c62 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:07.338095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61b2-f245-4c0d-8ed4-16f66c7a8c62 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:07.338381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61b2-f245-4c0d-8ed4-16f66c7a8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:07.356726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e26c61b2-f245-4c0d-8ed4-16f66c7a8c62 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:07.357930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e26c61b2-f245-4c0d-8ed4-16f66c7a8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:07.365719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 774/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:07.515078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08469-3ac6-45c0-a4fe-e582ca913f7a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:07.529917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b08469-3ac6-45c0-a4fe-e582ca913f7a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:07.535243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:07.535910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:07.536302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:07.536579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:07.545171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:07.546778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d2cfa-e04e-47c5-9f2b-7c76e6e4bc4e service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:07.555746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 744/1518] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:11.149533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0d41-608a-42fb-b113-3566d0595af5 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:11.150061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0d41-608a-42fb-b113-3566d0595af5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:11.150061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0d41-608a-42fb-b113-3566d0595af5 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:11.151558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 775/1519] 10.222.0.57 () {54 vars in 960 bytes} [Tue May 10 19:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:11.156631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4be184-02cd-40fa-9bf6-65f80eef98f9 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:11.157073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4be184-02cd-40fa-9bf6-65f80eef98f9 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:11.157172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4be184-02cd-40fa-9bf6-65f80eef98f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:11.176964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0f4be184-02cd-40fa-9bf6-65f80eef98f9 None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:11.178172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0f4be184-02cd-40fa-9bf6-65f80eef98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:11.187269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 745/1520] 10.222.0.57 () {58 vars in 1057 bytes} [Tue May 10 19:54:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:11.195028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0d41-608a-42fb-b113-3566d0595af5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:11.208717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0d41-608a-42fb-b113-3566d0595af5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:11.214214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:11.214875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:11.215156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:11.215427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:11.223845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:11.225430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210dd9e-0f34-4f83-9b67-076754b93f8c service placement] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:11.236149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 776/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:18.855979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e8855-aaab-4685-9d5c-42b5f40178fb None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:18.856496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e8855-aaab-4685-9d5c-42b5f40178fb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:18.856496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e8855-aaab-4685-9d5c-42b5f40178fb None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:18.857837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 746/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:18.862815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d756-24ac-4f0b-b2e8-6c606df1d35b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:18.863212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d756-24ac-4f0b-b2e8-6c606df1d35b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:18.863387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2d756-24ac-4f0b-b2e8-6c606df1d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:18.884149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-80a2d756-24ac-4f0b-b2e8-6c606df1d35b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:18.885371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-80a2d756-24ac-4f0b-b2e8-6c606df1d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:18.893169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 777/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:19.041771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e8855-aaab-4685-9d5c-42b5f40178fb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:19.056351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e8855-aaab-4685-9d5c-42b5f40178fb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:19.061624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:19.062250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:19.062561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:19.062842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:19.070737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:19.072328 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b938abd-c71b-43aa-83c9-fb95df2be72b service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:19.081450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 747/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:19.983038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8ea3-93f6-4fd5-845e-802ae9227f2e None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:19.983568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8ea3-93f6-4fd5-845e-802ae9227f2e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:19.983664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8ea3-93f6-4fd5-845e-802ae9227f2e None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:19.985041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 778/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 19:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:19.989938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285bca-34ce-41fd-a28b-0c12f7ffb9a0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:19.990362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285bca-34ce-41fd-a28b-0c12f7ffb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:19.990526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285bca-34ce-41fd-a28b-0c12f7ffb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:20.008770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-66285bca-34ce-41fd-a28b-0c12f7ffb9a0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:20.009950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-66285bca-34ce-41fd-a28b-0c12f7ffb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:20.017628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 748/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 19:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:20.169302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8ea3-93f6-4fd5-845e-802ae9227f2e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:20.183553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8ea3-93f6-4fd5-845e-802ae9227f2e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:20.188931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:20.189503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:20.189784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:20.190057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:20.197913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:20.199546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a4cce-ea1e-4d9e-b505-cfb622fcdb92 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:20.208528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 779/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:24.379173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:24.379797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:24.379797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:24.381111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 749/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:24.386340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23f6c-42d0-41a5-8a16-19128c01cec1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:24.386791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23f6c-42d0-41a5-8a16-19128c01cec1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:24.386939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23f6c-42d0-41a5-8a16-19128c01cec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:24.404210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-12c23f6c-42d0-41a5-8a16-19128c01cec1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:24.405407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-12c23f6c-42d0-41a5-8a16-19128c01cec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:24.413171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 780/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:24.449352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:24.451027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:24.507113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebe3db-55c9-45e4-b42e-39408c367820 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:24.510680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:24.511313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:24.511594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:24.511869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:24.520764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:24.522216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2bae3-29f8-4fe2-be0f-48e13d785912 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:24.531764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 750/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:54:26.716876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4be0-a563-43e4-acb5-4df25c2a56eb None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:26.717478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4be0-a563-43e4-acb5-4df25c2a56eb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:26.717478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c4be0-a563-43e4-acb5-4df25c2a56eb None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:26.718829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 781/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:26.723901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18bf0-ac97-4a90-adba-ec6d8656b9ae None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:26.724341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18bf0-ac97-4a90-adba-ec6d8656b9ae None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:26.724446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18bf0-ac97-4a90-adba-ec6d8656b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:26.743524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a6b18bf0-ac97-4a90-adba-ec6d8656b9ae None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:26.744763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a6b18bf0-ac97-4a90-adba-ec6d8656b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:26.752816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 751/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:26.786967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c4be0-a563-43e4-acb5-4df25c2a56eb None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:26.798176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c4be0-a563-43e4-acb5-4df25c2a56eb None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:26.801700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:26.802341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:26.802661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:26.802945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:26.812114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:26.813556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe458b0-f044-45cb-a332-f37ac55bd76a service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:26.822808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 782/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:30.601473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:30.602031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:30.602031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:30.603494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 752/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:30.608728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175863-89c4-4ecc-a5a4-1d72f1c34cff None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:30.609190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175863-89c4-4ecc-a5a4-1d72f1c34cff None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:30.609295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175863-89c4-4ecc-a5a4-1d72f1c34cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:30.627280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-77175863-89c4-4ecc-a5a4-1d72f1c34cff None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:30.628466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-77175863-89c4-4ecc-a5a4-1d72f1c34cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:30.636998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 783/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:54:30.907207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:30.908861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:30.965099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214746d7-f21d-4852-b8ee-2ae7efec78e2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:30.968628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:30.969271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:30.969556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:30.969835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:30.979237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:30.980663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e82e9-9743-47fd-8707-94a5ddbb4219 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:30.990082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 753/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:54:33.244896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:33.245459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:33.245459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:33.246909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 784/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 19:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:54:33.252509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5340b6-aac8-4dfa-becd-64a52631aee3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:33.252918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5340b6-aac8-4dfa-becd-64a52631aee3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:33.253077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5340b6-aac8-4dfa-becd-64a52631aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:33.272926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8c5340b6-aac8-4dfa-becd-64a52631aee3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:54:33.274697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8c5340b6-aac8-4dfa-becd-64a52631aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:33.282425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 754/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 19:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:54:33.558973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:54:33.560694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:54:33.573895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4111c6-bf46-4062-b0ca-fdf7d1082261 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:54:33.577363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:54:33.577987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:54:33.578266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:54:33.578564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:54:33.587925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:54:33.589371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed965481-7706-4cb5-97b0-eb2e3e6cf64b service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:54:33.598706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 785/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:07.200589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e637ba-f4f8-4247-b218-7ee69eab5023 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.201554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e637ba-f4f8-4247-b218-7ee69eab5023 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.201987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e637ba-f4f8-4247-b218-7ee69eab5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.227133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-55e637ba-f4f8-4247-b218-7ee69eab5023 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.229147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-55e637ba-f4f8-4247-b218-7ee69eab5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.246736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 755/1540] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.254776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.255446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.255558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.258192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa36f-678f-406a-8ded-8fff023916d0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.259213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa36f-678f-406a-8ded-8fff023916d0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.259724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa36f-678f-406a-8ded-8fff023916d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.286080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0a7fa36f-678f-406a-8ded-8fff023916d0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.288342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.288622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0a7fa36f-678f-406a-8ded-8fff023916d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.289689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.303758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 756/1541] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:07.305589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158db33-6523-401c-a0c7-9a4273745925 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.306056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158db33-6523-401c-a0c7-9a4273745925 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.306518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158db33-6523-401c-a0c7-9a4273745925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.309625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 786/1542] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:07.309926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.326500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f320ba6-8b89-46df-851c-ebae41cd5c89 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.334205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9158db33-6523-401c-a0c7-9a4273745925 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.335797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9158db33-6523-401c-a0c7-9a4273745925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.338103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.342484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.342484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.342484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.342484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:07.342484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.342939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:07.342939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:56:07.342939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:56:07.342939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc2cb-df5f-42bc-92ab-7fc9c48dd1a2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.356026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 757/1543] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.358005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.358549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.358992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.370486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 787/1544] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:07.370486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde157e4-e8b2-471d-bf0d-44c4be5036c1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.370486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde157e4-e8b2-471d-bf0d-44c4be5036c1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.370486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde157e4-e8b2-471d-bf0d-44c4be5036c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.390732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.392086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cde157e4-e8b2-471d-bf0d-44c4be5036c1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.392842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.393269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cde157e4-e8b2-471d-bf0d-44c4be5036c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.409308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 758/1545] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.410414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.410596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 788/1546] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.413189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.413492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.413775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.428300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5637d3-12ee-4cba-9a66-257d55478557 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.441799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.442783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.443203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.443607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.444543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.445688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:07.445688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:56:07.445688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:56:07.447197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc870a4f-092b-4d43-a2f2-ec0f70614fd3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.449968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.451266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.467361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 789/1547] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.468254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.479646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfb5a7-7078-41bd-88c0-3a90ea4feb1f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.483693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 759/1548] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.485088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9e92-6edf-4d44-9ed9-e36aef0fe6f0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.485088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9e92-6edf-4d44-9ed9-e36aef0fe6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.485088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d9e92-6edf-4d44-9ed9-e36aef0fe6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.486089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.487057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.487306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.487898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.488261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:07.488571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.490290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c4d62-dbcc-46cb-988e-2480ee2df4d8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.506495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 790/1549] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:07.506495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f06b7-6d2a-4ffd-911b-34687f94572f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.506495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f06b7-6d2a-4ffd-911b-34687f94572f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.506901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f06b7-6d2a-4ffd-911b-34687f94572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.511355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-152d9e92-6edf-4d44-9ed9-e36aef0fe6f0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.512655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-152d9e92-6edf-4d44-9ed9-e36aef0fe6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.528616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b43f06b7-6d2a-4ffd-911b-34687f94572f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.529876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b43f06b7-6d2a-4ffd-911b-34687f94572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.570863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 760/1550] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.572154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.572448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.572722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.589978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.590846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 791/1551] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.591194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.592137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.592430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.592706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.599878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 761/1552] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.600568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.609543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d022c3-b539-47bd-b4bf-c9c6ebc537f7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.613795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.614065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.614758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.615040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.615138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.615316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.616090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:07.616399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.617979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.623050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 792/1553] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.623843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.629838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 762/1554] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:07.631063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.638774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab206be-8b59-4d7f-8bcc-acfec3dec6b8 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.640290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872fc2-616a-4d78-8842-adac28f1759a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.643613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.644277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.644564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.644755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.644887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.645379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.645517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.645659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.645954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.646627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:07.646627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:56:07.646627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:56:07.646896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.647826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b231b-d6a3-4ffe-9888-3d0019d7a8ab admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.648568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.669449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 793/1555] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.670958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc452-8952-4931-9f88-9bb3374e0016 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.671307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc452-8952-4931-9f88-9bb3374e0016 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.671596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc452-8952-4931-9f88-9bb3374e0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.677046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 763/1556] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.678672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.690548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3f5cc452-8952-4931-9f88-9bb3374e0016 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.691871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3f5cc452-8952-4931-9f88-9bb3374e0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.747590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abacc4-b727-4688-9039-3a20144bc1c2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.752570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.753245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.753531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.753645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 794/1557] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.753835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.754648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:07.754898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a982-6598-4668-8bc3-2159fd22bd40 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.755011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.755192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a982-6598-4668-8bc3-2159fd22bd40 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.755526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a982-6598-4668-8bc3-2159fd22bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.756615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478f71e-e0eb-441f-a33b-c59e36cf7781 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.768798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 764/1558] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:07.770126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.770418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.770724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.776309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b5a0a982-6598-4668-8bc3-2159fd22bd40 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.777505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b5a0a982-6598-4668-8bc3-2159fd22bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.785455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 795/1559] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.787247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.787536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.787810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.788872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.790056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.797826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 765/1560] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.798606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.806356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.807544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.808039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d06ea-e73f-4879-b6d3-e2822f4d8f21 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.812459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.813160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.813444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.813716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.814387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.816457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 796/1561] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.817690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.819263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.828837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcac186-a907-4abb-bfd5-548a93dcab4c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.834122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.835070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.835356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.835633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.836572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.838386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff4383-2e24-4536-90d0-77f7e9a5d563 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.843077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 766/1562] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.844085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.851847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 797/1563] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:07.851847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.851847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.851847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.869382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:07.870626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:07.908785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d402bd3-82d8-4577-835e-98f960f52e40 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.914108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.914806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.915091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.915387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.916074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.918283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.929740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 798/1564] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:07.930778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.939969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19b356-4413-4bd4-9267-e47d95f66055 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.944067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 767/1565] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.944067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.944518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.945218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.945500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.945773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.946481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.948376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.951936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c2d7e-e900-41f0-98b4-ab53ec9980af admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:07.956747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:07.957392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:07.957680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:07.958046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:07.958802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:07.959116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:07.960717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:07.976253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 799/1566] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:07 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:07.976253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.976551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 768/1567] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:07.976551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:07.985445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f1bac-82e7-4471-a26e-2d3c536e0cde admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.044685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.044988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26fe63-b9cb-41fb-a66d-a072136181d6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.045355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.045643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.045950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.046706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:08.047014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.048726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.049594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.052048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.052384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.052667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.053402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:08.053706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.055328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.060663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 769/1568] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:08.061469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.068262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 800/1569] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:08.069279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.079547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5c00b-b67a-40f8-8f7f-56693b4297f7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.079903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26c02-777a-449a-af02-40bdabfb1115 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.084877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.085133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.085543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.085830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.086109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.086366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.086586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.086873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.087734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.087870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.089693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.089825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.103538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 801/1570] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.104635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.114054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 770/1571] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.115123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.117921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562fb1b-dad5-491b-844c-af2dc2bd5740 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.122573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.123227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.123510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.123786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.124774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:08.125079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.125174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585079f-f23c-4afd-a552-4030faca84b2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.126713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.129888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.130685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.131089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.131437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.132259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.133947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.138147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 802/1572] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:08.138955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.147986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 771/1573] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.147986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.152069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd551863-6bfa-4a25-97db-1b3669f6b62b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.155101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bc87-934b-4661-9855-cb6f21569069 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.156790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.157444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.157727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.158004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.158722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.159783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.160414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.160635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.160761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.160963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.162198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.164121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.183643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 803/1574] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.184577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.194138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d692-8e36-48e7-966b-3352711c5f9c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.194852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 772/1575] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.195667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.252200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.252776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.253062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.253338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.254027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.256054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.258764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6df03-6aee-429b-a53e-2e0cfdf81436 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.263308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.263965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.264248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.264528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.265214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.267154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.284610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 804/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.284610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.300489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 773/1577] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.300489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.341854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585a52-3020-49fb-89f5-918d907d3b70 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.358144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14dccf-1e51-4dfb-bebf-8b918b1a101c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.363691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.363865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.364106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.364388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.365109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.366723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.377049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 774/1578] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.377958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.388307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6539b-9b09-4df0-9898-c8dd8923d814 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.393071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.393736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.394020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.394293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.395025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.398294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.401051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.402038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.402381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.402691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] PATH_INFO: `/v3/projects/bfb1f4857a6e438e87e546dfd1d8a8b9/users/0b7dead8216e4cd59eaa15ad8842e38a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.417317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb1f4857a6e438e87e546dfd1d8a8b9, user_id=0b7dead8216e4cd59eaa15ad8842e38a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.420354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.424354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 775/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.425450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.436260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 805/1580] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:08 2022] PUT /identity/v3/projects/bfb1f4857a6e438e87e546dfd1d8a8b9/users/0b7dead8216e4cd59eaa15ad8842e38a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:08.437300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.486004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084120d-dc69-4ed3-9347-b72f3ca0266e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.496324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b8c8-efba-48b8-91ef-75cbea5ef1ac admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.501416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.501871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.502149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.502501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.503162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.504857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.517954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 806/1581] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.517954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.526991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05aa08-910b-4614-85de-383e6a4502f1 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.531932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.532648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.532955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.533226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.533912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.535870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.542210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.542905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.543186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.543469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.544195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.545816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.555438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 807/1582] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.559387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.559527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 776/1583] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.559527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.566476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf78ba-da8e-48a0-bdf4-842ac91b50b5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.569058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aa2c5-9a05-46ef-a2e2-ae14904a690b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.571587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.572231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.572516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.572796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.573475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.573590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.574211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.574526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.574810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.575412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.575509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.577447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.596700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 777/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.597243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 808/1585] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.597905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.598067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.609506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc606c3e-0751-4088-a642-196a4c980c6a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.609694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f1c3-6684-418d-9ab0-4e4d65674d11 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.614121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.614350 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.614846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.615130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.615252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.615441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.615558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.615715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.616115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.616383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.617947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72dea7-d7e4-4cc8-9176-19180b52a03b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.618057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.628757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 778/1586] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.630227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.631266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.631568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.642162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 809/1587] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:08.643180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.652654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:08.653596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e576767-df40-4334-817e-665da8233a0c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.653871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:08.658302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.658994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.659282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.659559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.660290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.661654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 779/1588] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:08.661922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.665751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.672098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 810/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.672911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.678910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb5b52-c69b-42dc-becb-f1b4eaadb323 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.683609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.684269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.684546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.684779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ac07-6cfc-4e6f-9395-2c67bb51114f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.684898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.685524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.687192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.689367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.690237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.690548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.690828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] PATH_INFO: `/v3/projects/efc2cb6282464330a0ec75c83167865e/users/d996a13df5074d1cb8a604f013581f04/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.697458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 780/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.698318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.707663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc2cb6282464330a0ec75c83167865e, user_id=d996a13df5074d1cb8a604f013581f04, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.708244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194f38-330c-4731-af2a-aabe66fc75dc admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.710934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.713445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.714088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.714380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.714670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.715419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.717341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.724073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 811/1591] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:08 2022] PUT /identity/v3/projects/efc2cb6282464330a0ec75c83167865e/users/d996a13df5074d1cb8a604f013581f04/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:08.724882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.734028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 781/1592] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.734028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.743787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c8b80-79ea-40fe-abba-698fcf70d9e0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.784517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a447e-fa1b-413b-8d5a-6199eb7e71fe admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.788981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.789635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.789917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.790191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.790951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.792541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.799535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.800416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.800696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.800970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] PATH_INFO: `/v3/projects/866e5dd5364e4bd980ba03f1b76aac9d/users/b642ac529ee043fd894a9188f30ed026/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.802007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 812/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.803423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.814410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cefe7-ddd7-4bfc-b9cf-00eca18796c8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.819470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.820106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.820392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.820653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866e5dd5364e4bd980ba03f1b76aac9d, user_id=b642ac529ee043fd894a9188f30ed026, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.820775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.821354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.821685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:08.821685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:56:08.821685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:56:08.822941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.823648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.832989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 813/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:08.836154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 782/1595] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:08 2022] PUT /identity/v3/projects/866e5dd5364e4bd980ba03f1b76aac9d/users/b642ac529ee043fd894a9188f30ed026/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:08.836951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.839485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.846575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cfa05-d199-4a10-bccc-b06fc5c4cd7d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.892341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c52e-b85d-4a20-9bf2-6d6f2be86045 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.895907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.896545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.896828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.897102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.900818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:08.901699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.901986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.902271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] PATH_INFO: `/v3/projects/477a9d7174e544efbbe7803ca7e77521/users/2751fce03c284a91b152f545bd8c63ce/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.906106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.907754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.916502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a9d7174e544efbbe7803ca7e77521, user_id=2751fce03c284a91b152f545bd8c63ce, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:08.917886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 783/1596] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:08.918707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:08.919232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca2786-f312-44c9-8fb9-666f132fc404 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:08.928744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573d46-8e92-4244-a2e6-27e066fab8e2 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:08.934410 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 814/1597] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:08 2022] PUT /identity/v3/projects/477a9d7174e544efbbe7803ca7e77521/users/2751fce03c284a91b152f545bd8c63ce/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:08.935596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:08.936097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:08.936455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:08.959313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:08.961272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:08.999050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.001358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.001927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.002374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.003329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.005222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.017083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 784/1598] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:09.017999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.029770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a9b0-60f7-4087-8156-be77b75fc4a6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.031620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 815/1599] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.032647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.038735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.039414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.039773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.039958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.040834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.042815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.051320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbce45-57fe-4a5d-a20b-7cacbbb2bd2b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.053926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 785/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:09.054626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.057404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.058593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.058593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.058991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.059817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.061755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2b06c-5354-45c6-b216-3d490217e5e6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.066881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035993bf-f915-4d5c-b8d8-0ffdc2fb971d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.072705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.073279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 816/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:09.074688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.075042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.075383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.076628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.076925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.077207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.077998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.080523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533450b3-054e-4343-afbf-5cfe039a765f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.095408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.096494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.098831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 786/1602] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:09.100543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.100878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.101184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.110386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 817/1603] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.112000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.125548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.126803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.129769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439029fd-cce9-49be-b17d-2e312f5f579c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.135150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 787/1604] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.135591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.136575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.136860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.137131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] PATH_INFO: `/v3/projects/1b813fb184334b39bc1facf8b3de8b60/users/e52e91625cbe4e5faaa45ade47ff8599/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.139279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.141230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.156758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b813fb184334b39bc1facf8b3de8b60, user_id=e52e91625cbe4e5faaa45ade47ff8599, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.160146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.175790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 818/1605] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:09 2022] PUT /identity/v3/projects/1b813fb184334b39bc1facf8b3de8b60/users/e52e91625cbe4e5faaa45ade47ff8599/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:09.176768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.208148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d12a-dd9b-4da1-a15d-eaf5c50847da None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.253586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a7dc-0a8b-4521-865f-ceb4a77c2450 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.259265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.260290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.260681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.261118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] PATH_INFO: `/v3/projects/f9036a880d834160bb39daa95d3878ae/users/41841372e4aa4fc081ce994d7ac3a24b/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.265382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.266168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.266480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.266769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.278115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9036a880d834160bb39daa95d3878ae, user_id=41841372e4aa4fc081ce994d7ac3a24b, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.278317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.279673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.280826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.291927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 788/1606] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:09.293633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.303030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 819/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:09 2022] PUT /identity/v3/projects/f9036a880d834160bb39daa95d3878ae/users/41841372e4aa4fc081ce994d7ac3a24b/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:09.303944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.312412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ee02e-7120-41b4-b3aa-37059725a368 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.393190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.393813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7143c73-58c6-41c3-9465-88b516de70fc admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.394705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.395258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.395706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] PATH_INFO: `/v3/projects/25b61967dc5c42ceb097f40a01045bfa/users/7f3cef4a86dd4b9cb57619148760ba88/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.399668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.400775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.401065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.401353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] PATH_INFO: `/v3/projects/aa90dbe567f64d1baef66ee3292ba7fb/users/5cc7460a926a47eeb676d7ffdf0102c8/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.415866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b61967dc5c42ceb097f40a01045bfa, user_id=7f3cef4a86dd4b9cb57619148760ba88, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.419100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.420395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa90dbe567f64d1baef66ee3292ba7fb, user_id=5cc7460a926a47eeb676d7ffdf0102c8, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.423361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.437864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 789/1609] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:09 2022] PUT /identity/v3/projects/25b61967dc5c42ceb097f40a01045bfa/users/7f3cef4a86dd4b9cb57619148760ba88/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:09.438091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 820/1609] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:09 2022] PUT /identity/v3/projects/aa90dbe567f64d1baef66ee3292ba7fb/users/5cc7460a926a47eeb676d7ffdf0102c8/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:09.438952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.440082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.501691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473efc-d7e6-459f-9d3b-15cfd32def4f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.507359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.508269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.508551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.508857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.509458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fbf19-2237-4dd0-868f-fcde2b65cc9e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.513140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.515034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.515034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.515275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.581211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.582745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21ab76-5257-448f-8bdc-f621df2e8c10 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.585826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.587503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7b3b9-d683-401f-a004-f1f5272981f9 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.594532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 821/1610] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:09.595640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82edc31-21c2-4594-977c-8a04617ab04e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.595962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82edc31-21c2-4594-977c-8a04617ab04e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.596208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82edc31-21c2-4594-977c-8a04617ab04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.599869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 790/1611] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:09.601066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4cd4-ad2c-49a6-abb7-519be110247e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.601368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4cd4-ad2c-49a6-abb7-519be110247e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.601633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4cd4-ad2c-49a6-abb7-519be110247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.624849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e82edc31-21c2-4594-977c-8a04617ab04e None None] MFA Rules not processed for user `e52e91625cbe4e5faaa45ade47ff8599`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.626095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e82edc31-21c2-4594-977c-8a04617ab04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.629627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-595f4cd4-ad2c-49a6-abb7-519be110247e None None] MFA Rules not processed for user `41841372e4aa4fc081ce994d7ac3a24b`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.631530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-595f4cd4-ad2c-49a6-abb7-519be110247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.699541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 822/1612] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.701346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2585c4-62fe-4605-bc80-2e58f0914159 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.701735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2585c4-62fe-4605-bc80-2e58f0914159 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.702300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2585c4-62fe-4605-bc80-2e58f0914159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.721288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 791/1613] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.723462 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8a2585c4-62fe-4605-bc80-2e58f0914159 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.724979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8a2585c4-62fe-4605-bc80-2e58f0914159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.726300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.726300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.726565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.735789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 823/1614] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.737234 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2441f-7768-4e17-af2d-e2fc8983547e None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.737524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2441f-7768-4e17-af2d-e2fc8983547e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.737800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2441f-7768-4e17-af2d-e2fc8983547e None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.739259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 824/1615] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 19:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:09.740806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2441f-7768-4e17-af2d-e2fc8983547e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.761207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2441f-7768-4e17-af2d-e2fc8983547e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.767218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] MFA Rules not processed for user `5cc7460a926a47eeb676d7ffdf0102c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.767942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.768469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.768847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.769334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.769911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.771246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:09.773208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e011-929a-4574-9b8a-20b3be99ae3f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:09.804412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 825/1616] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:09.805868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.806216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.806568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.826034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:09.827433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:09.841542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 792/1617] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.842319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:09.862068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e18fab-2e07-4e5f-b11a-92ba1f8a2f65 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:09.924705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:09.925109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:09.925294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:09.925773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:09.931493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 826/1618] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:09.939371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.000122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.001862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ffa95-af19-40d2-90ba-821df8dcb1d3 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.014656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993bd1-f511-4aae-8dcc-62d61c689329 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.019540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.020319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.020678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.021060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.021873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.024328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f653-31c4-4ca3-89b7-fa975410462a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.025060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 793/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:10.026480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e284bf-bfa9-4613-abd3-2ddfa897eb95 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.026764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e284bf-bfa9-4613-abd3-2ddfa897eb95 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.027020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e284bf-bfa9-4613-abd3-2ddfa897eb95 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.039045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 794/1620] 10.222.0.57 () {54 vars in 961 bytes} [Tue May 10 19:56:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:10.042661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e284bf-bfa9-4613-abd3-2ddfa897eb95 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.054335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 827/1621] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:09 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:10.055693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.056086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.056467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.077657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:10.079086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:10.084735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e284bf-bfa9-4613-abd3-2ddfa897eb95 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.097338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.100148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.101045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 828/1622] 10.222.0.57 () {58 vars in 1058 bytes} [Tue May 10 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:10.101944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.102655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.105110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.134947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818beb-8848-4a5c-a670-7b66156b362d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.146751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.148598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.148887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.150407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.154869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.160382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.191945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 829/1623] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:10.195315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.225574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5a133-90fe-4b70-beee-9b0569d5cced admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.242780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.243679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.243973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.244261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.249050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.251401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.292318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 795/1624] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:10.294849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.339165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8df25-9aaf-4b76-b55e-9a1c37a1003b service nova] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.345270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.347310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.347871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.348249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] PATH_INFO: `/v3/projects/7e9f5751e6b141fe911af3b945aaed9a/users/0dcfe3fcd5144a73b687b3d6f507e0fa/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.371629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.372173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9f5751e6b141fe911af3b945aaed9a, user_id=0dcfe3fcd5144a73b687b3d6f507e0fa, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.373240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.375242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.395474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 796/1625] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:10 2022] PUT /identity/v3/projects/7e9f5751e6b141fe911af3b945aaed9a/users/0dcfe3fcd5144a73b687b3d6f507e0fa/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:10.400808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.403206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 830/1626] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:10.504969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caece2-3261-4572-a5e0-e1c3c5fbe9fd admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.512227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.513269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.513842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.514395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.515479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.535584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db00cb-90b1-4dce-a4d3-9cbd163bc779 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.550008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 797/1627] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:10.555302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.577953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d047fb-3224-45c1-aac0-ee277345b004 service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:10.590969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:10.608536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.609105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.609981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] PATH_INFO: `/v3/projects/7e9f5751e6b141fe911af3b945aaed9a/users/0dcfe3fcd5144a73b687b3d6f507e0fa/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.623702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9f5751e6b141fe911af3b945aaed9a, user_id=0dcfe3fcd5144a73b687b3d6f507e0fa, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:10.634675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e22a94-a3eb-4ccb-813f-ee30db9bccbc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:10.672256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 831/1628] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:10 2022] PUT /identity/v3/projects/7e9f5751e6b141fe911af3b945aaed9a/users/0dcfe3fcd5144a73b687b3d6f507e0fa/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:10.680532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e5cb-1fba-4d57-b7f0-3f171d2a2896 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.681070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e5cb-1fba-4d57-b7f0-3f171d2a2896 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.681455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e5cb-1fba-4d57-b7f0-3f171d2a2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.751728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-ee80e5cb-1fba-4d57-b7f0-3f171d2a2896 None None] MFA Rules not processed for user `0dcfe3fcd5144a73b687b3d6f507e0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:10.757096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7bbad-66b3-49af-b8a0-c41f0eb83a17 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.757518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7bbad-66b3-49af-b8a0-c41f0eb83a17 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.757896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7bbad-66b3-49af-b8a0-c41f0eb83a17 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.759992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 832/1629] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 19:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:10.760571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ee80e5cb-1fba-4d57-b7f0-3f171d2a2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:10.765312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.765672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.766024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.821071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:10.826507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:10.926452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 798/1630] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:10.926452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c9bc-1bf7-4057-a461-ebb3ae098cb0 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.926452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c9bc-1bf7-4057-a461-ebb3ae098cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.926452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688c9bc-1bf7-4057-a461-ebb3ae098cb0 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.929131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 799/1631] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 19:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:10.934919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:10.935224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:10.935495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:10.958758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 833/1632] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:10.960402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:10.986257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:10.989573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:11.020138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 800/1633] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:56:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:11.031367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.067457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb73b9d-5dcf-4049-acbe-6e4568ba695e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.073254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.073959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.074258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.074568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.088553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.090261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e96e4-a727-4e6d-8d9d-641e4c0fe125 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.103749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 834/1634] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:11.106762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.107060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.107480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.162496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] MFA Rules not processed for user `d996a13df5074d1cb8a604f013581f04`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:11.163846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:11.190384 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ed95-46c7-4930-a4c7-4dbf80b9a46a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.200784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.201663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.202064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.202489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.237763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.239451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.247132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 835/1635] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:11.248184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.260257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25732b-1ff9-498a-a5f3-4ce694a06fc1 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.265537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.265684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.266190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.266594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.271290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 801/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:11.273975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.286176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.288908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.305483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 836/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:11.421757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e6325-1c74-4a95-b812-8902f2d0e506 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.435190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.436033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.436412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.436786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.437762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.442147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.503377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 802/1638] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:11 2022] POST /identity/v3/projects => generated 403 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:11.508532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.523342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103dc88-429b-4448-824f-98253e52c074 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.601339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.602025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.602447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.602919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.603697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.606061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.639338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 837/1639] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:11 2022] POST /identity/v3/users => generated 308 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:11.642405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.660015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cab87-426b-4a46-8d03-6a8a18c42cbe admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.668686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.669555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.669905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.670355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.671539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.674427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.691160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 803/1640] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:11.695791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.713080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346287-81cb-49b6-81a1-0bb6625917d0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.729030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.730215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.730607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.730959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] PATH_INFO: `/v3/projects/981b712756ec4b1fa5887b6cf720c8f8/users/3a9d0c2a47e042929ae7def97446c4a4/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.757096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] RBAC: Authorizing `identity:create_grant(project_id=981b712756ec4b1fa5887b6cf720c8f8, user_id=3a9d0c2a47e042929ae7def97446c4a4, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.761720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:11.791816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 838/1641] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:11 2022] PUT /identity/v3/projects/981b712756ec4b1fa5887b6cf720c8f8/users/3a9d0c2a47e042929ae7def97446c4a4/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:11.796510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:11.814610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655864-ab79-4f68-ac8d-822dc6457920 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:11.978115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:11.980643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:11.982411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:11.983757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:11.985836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:11.990836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:12.028192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:12.039935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 804/1642] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:12.044778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9be0c-7205-4645-835c-26d7e42378be admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:12.056373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:12.057521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:12.059762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:12.060162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] PATH_INFO: `/v3/projects/981b712756ec4b1fa5887b6cf720c8f8/users/3a9d0c2a47e042929ae7def97446c4a4/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:12.066146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981b712756ec4b1fa5887b6cf720c8f8, user_id=3a9d0c2a47e042929ae7def97446c4a4, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:12.074502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbab3-9e01-43cc-9284-886577737167 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:12.109798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 839/1643] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:12 2022] PUT /identity/v3/projects/981b712756ec4b1fa5887b6cf720c8f8/users/3a9d0c2a47e042929ae7def97446c4a4/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:12.678813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:12.795585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec65a9f-ccd0-4ea6-838c-ee44d75c89df admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:12.858556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:12.859997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:12.860387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:12.860765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:12.957723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:12.959588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b629b1-16f2-490b-b9e8-7c6212bfb755 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:12.970477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 805/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:13.218576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:13.219187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:13.219187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:13.267245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] MFA Rules not processed for user `7f3cef4a86dd4b9cb57619148760ba88`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:13.268403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:13.419954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 840/1645] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:13.424847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44f49-b837-4cdc-b6a5-b3829af6594d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:13.425128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44f49-b837-4cdc-b6a5-b3829af6594d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:13.425735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44f49-b837-4cdc-b6a5-b3829af6594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:13.455233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-83e44f49-b837-4cdc-b6a5-b3829af6594d None None] MFA Rules not processed for user `7f3cef4a86dd4b9cb57619148760ba88`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:13.457149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-83e44f49-b837-4cdc-b6a5-b3829af6594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:13.476306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 806/1646] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:13.492661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:13.581386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa12cb-0ec4-458d-b78b-67dd0b13e888 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:13.587798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:13.588859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:13.589023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:13.589656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:13.605663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:13.607357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a9e8b-a969-4f35-8b95-ff3eb8228e82 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:13.622927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 841/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:15.336481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74279-2ada-4201-b4c6-856119477228 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:15.337430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74279-2ada-4201-b4c6-856119477228 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:15.337917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa74279-2ada-4201-b4c6-856119477228 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:15.339965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 807/1648] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 19:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:15.347111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afee71b-b970-4595-a9e2-65f38e73388a None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:15.348189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afee71b-b970-4595-a9e2-65f38e73388a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:15.348669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afee71b-b970-4595-a9e2-65f38e73388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:15.427007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7afee71b-b970-4595-a9e2-65f38e73388a None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:15.429848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7afee71b-b970-4595-a9e2-65f38e73388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:15.516877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 842/1649] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:15.582557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa74279-2ada-4201-b4c6-856119477228 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:15.597593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa74279-2ada-4201-b4c6-856119477228 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:15.606994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:15.607712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:15.608050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:15.608338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:15.619919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:15.621618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09761783-bb48-466c-a0b3-07ecbdedebbb service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:15.633622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 808/1650] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:15.700511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6187-5d00-4062-bec9-ed224dc2cb02 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:15.700823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6187-5d00-4062-bec9-ed224dc2cb02 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:15.701079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6187-5d00-4062-bec9-ed224dc2cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:15.770111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4a5a6187-5d00-4062-bec9-ed224dc2cb02 None None] MFA Rules not processed for user `3a9d0c2a47e042929ae7def97446c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:15.775836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4a5a6187-5d00-4062-bec9-ed224dc2cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:15.930664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 843/1651] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:17.018141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5cd35-7740-417d-aae9-aa7f29de4454 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:17.018690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5cd35-7740-417d-aae9-aa7f29de4454 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:17.018783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5cd35-7740-417d-aae9-aa7f29de4454 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:17.020821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 809/1652] 10.222.0.57 () {54 vars in 960 bytes} [Tue May 10 19:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:17.026580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:17.027071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:17.027165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:17.066659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] MFA Rules not processed for user `722cc57a4637431686105db8181fdd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:17.068706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:17.200605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 844/1653] 10.222.0.57 () {58 vars in 1057 bytes} [Tue May 10 19:56:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:17.207600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5cd35-7740-417d-aae9-aa7f29de4454 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:17.241337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5cd35-7740-417d-aae9-aa7f29de4454 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:17.258336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:17.259226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:17.259602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:17.259979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:17.263185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:17.290271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:17.295923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78c05-d665-4dff-92f7-063f103fa494 service placement] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:17.321667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 810/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:18.575498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:18.736715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436005c-b92b-4314-bfe3-e428641b75ce None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:18.767822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:18.768916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:18.769330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:18.771693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] PATH_INFO: `/v3/users/e52e91625cbe4e5faaa45ade47ff8599` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:18.775064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52e91625cbe4e5faaa45ade47ff8599)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:18.784267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:18.890251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52e91625cbe4e5faaa45ade47ff8599'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:18.904308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52e91625cbe4e5faaa45ade47ff8599'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:18.920216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52e91625cbe4e5faaa45ade47ff8599'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:18.920985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52e91625cbe4e5faaa45ade47ff8599'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:18.921849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52e91625cbe4e5faaa45ade47ff8599'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:18.983269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 845/1655] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:18 2022] DELETE /identity/v3/users/e52e91625cbe4e5faaa45ade47ff8599 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:18.987515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:18.987995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:18.988064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:19.044998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:19.046307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:19.246376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 811/1656] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:19.263056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:19.264753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:19.413290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eb09-b6d6-47de-98cb-59674fa88e3f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:19.425304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:19.426161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:19.427418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:19.427907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:19.448976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:19.450788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921a373-ddd3-40d0-a087-549853d8c397 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:19.476552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 846/1657] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:20.493588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:20.496387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:20.564177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0a75-e65f-4fc6-b706-766234c30ba6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:20.578968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:20.579862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:20.580144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:20.580421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] PATH_INFO: `/v3/users/d996a13df5074d1cb8a604f013581f04` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:20.586252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d996a13df5074d1cb8a604f013581f04)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:20.587352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: WARNING py.warnings [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:20.587352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: warnings.warn(msg) May 10 19:56:20.587352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: May 10 19:56:20.589010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:20.736103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd996a13df5074d1cb8a604f013581f04'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:20.772676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd996a13df5074d1cb8a604f013581f04'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:20.778588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd996a13df5074d1cb8a604f013581f04'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:20.825883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd996a13df5074d1cb8a604f013581f04'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:20.827351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd996a13df5074d1cb8a604f013581f04'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:20.860599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 812/1658] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:20 2022] DELETE /identity/v3/users/d996a13df5074d1cb8a604f013581f04 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:21.693187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d656539-1d77-4af6-b145-e03250334537 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:21.693670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d656539-1d77-4af6-b145-e03250334537 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:21.693750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d656539-1d77-4af6-b145-e03250334537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:21.707747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:21.714032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:21.757207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3d656539-1d77-4af6-b145-e03250334537 None None] MFA Rules not processed for user `2751fce03c284a91b152f545bd8c63ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:21.759199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3d656539-1d77-4af6-b145-e03250334537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:21.858838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 847/1659] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:21.865292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d656539-1d77-4af6-b145-e03250334537 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:21.867064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa197-c07c-4f6f-afb5-85e900473d36 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:21.867421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3d656539-1d77-4af6-b145-e03250334537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:21.873797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:21.875203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:21.875814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:21.876294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] PATH_INFO: `/v3/projects/efc2cb6282464330a0ec75c83167865e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:21.877960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc2cb6282464330a0ec75c83167865e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:21.882221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:21.995289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d656539-1d77-4af6-b145-e03250334537 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:22.000540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc2cb6282464330a0ec75c83167865e', 'request_id': 'req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.010916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc2cb6282464330a0ec75c83167865e', 'request_id': 'req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.023005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc2cb6282464330a0ec75c83167865e', 'request_id': 'req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.041912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] The token cache is being invalidate because project efc2cb6282464330a0ec75c83167865e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:22.042980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.044873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.048121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 813/1660] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:21 2022] DELETE /identity/v3/projects/efc2cb6282464330a0ec75c83167865e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:22.053158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:22.055185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.116667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:22.117325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.117715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.118124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.120940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.191811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005461-8c73-4c30-ad2d-7b566f7f4aa0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:22.204413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:22.205304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.205584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.205858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] PATH_INFO: `/v3/projects/1b813fb184334b39bc1facf8b3de8b60` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.207127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b813fb184334b39bc1facf8b3de8b60)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:22.210409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:22.237243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:22.239880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:22.266474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 848/1661] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:22.273244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:22.281646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.291045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b813fb184334b39bc1facf8b3de8b60', 'request_id': 'req-9dd18211-40df-42cb-95ee-e4582f506bca'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.302352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b813fb184334b39bc1facf8b3de8b60', 'request_id': 'req-9dd18211-40df-42cb-95ee-e4582f506bca'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.308488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa8a36-6593-4f88-97bc-e9e2ef69eb73 service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:22.315857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b813fb184334b39bc1facf8b3de8b60', 'request_id': 'req-9dd18211-40df-42cb-95ee-e4582f506bca'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.335225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] The token cache is being invalidate because project 1b813fb184334b39bc1facf8b3de8b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:22.335516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.338264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9dd18211-40df-42cb-95ee-e4582f506bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.343594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 814/1662] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:22 2022] DELETE /identity/v3/projects/1b813fb184334b39bc1facf8b3de8b60 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:22.348625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5ed1-cab8-4dd4-a618-a8ee4cf79299 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.348980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5ed1-cab8-4dd4-a618-a8ee4cf79299 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.349369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e5ed1-cab8-4dd4-a618-a8ee4cf79299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.400059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d53e5ed1-cab8-4dd4-a618-a8ee4cf79299 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:22.411425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d53e5ed1-cab8-4dd4-a618-a8ee4cf79299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.564667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:22.568775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.571085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.571783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] PATH_INFO: `/v3/users/3a9d0c2a47e042929ae7def97446c4a4` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.577408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9d0c2a47e042929ae7def97446c4a4)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:22.582765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:22.688780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 815/1663] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:22.698329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.698329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.698329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.749400 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:22.750874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.772848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9d0c2a47e042929ae7def97446c4a4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.804299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 816/1664] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:22.809230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:22.811175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9d0c2a47e042929ae7def97446c4a4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.828304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9d0c2a47e042929ae7def97446c4a4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.829340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9d0c2a47e042929ae7def97446c4a4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.830301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9d0c2a47e042929ae7def97446c4a4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:22.843240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe11722-cdc1-4e2b-be58-7ae79f002034 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:22.856951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:22.861251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:22.861574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:22.862728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:22.867062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:22.868241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:22.869673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 849/1665] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:22 2022] DELETE /identity/v3/users/3a9d0c2a47e042929ae7def97446c4a4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:22.870901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:22.873007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:22.875858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:22.941913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 817/1666] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:22.947169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:22.959818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:23.028369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d4854-61c1-4bdf-aec6-93d1eecddbe4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.043959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.044717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.045007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.045288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.047886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.058574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.081451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343b75-9c69-48c6-b710-9274d62957f2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.105722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 818/1667] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:22 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:23.106993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.109352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.109748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.110154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] PATH_INFO: `/v3/users/5cc7460a926a47eeb676d7ffdf0102c8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.112686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc7460a926a47eeb676d7ffdf0102c8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.112804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:23.124498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.269149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeec6-373b-48c2-a4b4-1ebb4eb6fdf6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.280305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.281004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.281292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.281571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.282282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.301834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.323669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc7460a926a47eeb676d7ffdf0102c8'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:23.333322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc7460a926a47eeb676d7ffdf0102c8'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:23.344688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc7460a926a47eeb676d7ffdf0102c8'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:23.347308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc7460a926a47eeb676d7ffdf0102c8'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:23.348139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dc0913c9-1b77-48e0-857e-d8d7ca7965d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc7460a926a47eeb676d7ffdf0102c8'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:23.391372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 819/1668] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:23 2022] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:23.400731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 850/1669] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:22 2022] DELETE /identity/v3/users/5cc7460a926a47eeb676d7ffdf0102c8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:23.407677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:23.413106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:23.413262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76fa0-de61-48e9-88dc-bea3dd5ab8dd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.413514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76fa0-de61-48e9-88dc-bea3dd5ab8dd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.413793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76fa0-de61-48e9-88dc-bea3dd5ab8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.432543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01430f33-edea-4675-8908-2bc785b77d67 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.500422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f8a76fa0-de61-48e9-88dc-bea3dd5ab8dd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:23.506935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f8a76fa0-de61-48e9-88dc-bea3dd5ab8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:23.512898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.514650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.515217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.515788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.516811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.518877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.561471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 820/1670] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:23.567073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:23.581681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 851/1671] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:23.594189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.594837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.595260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.614122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15b59-aad5-4d6e-ba62-086bde8202b6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.628956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.630294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.637366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.637366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.637366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.648044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.658909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:23.665545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:23.691256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 821/1672] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:23.693476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:23.701885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:23.885402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 852/1673] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:56:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:23.901664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:23.928764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe68e2-4ed4-4993-983d-cfa25964859d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.934425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a25a3-e937-4515-8362-b496298da5da admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:23.938438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.939120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.939527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.939684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.949025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:23.949939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:23.950219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:23.951080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] PATH_INFO: `/v3/projects/997bd75c3a0b4be3a3a4dacac7099774/users/518a726b993148959be2ff8084809bc5/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:23.968390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.971519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2dcd-9f0a-4669-ab9e-e5a02c2deedf service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:23.980397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997bd75c3a0b4be3a3a4dacac7099774, user_id=518a726b993148959be2ff8084809bc5, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:23.983201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:24.009020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 822/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:24.013427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 853/1675] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:23 2022] PUT /identity/v3/projects/997bd75c3a0b4be3a3a4dacac7099774/users/518a726b993148959be2ff8084809bc5/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:24.022787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.023333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.023727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.094744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] MFA Rules not processed for user `518a726b993148959be2ff8084809bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:24.097169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.158032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:24.163714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.285732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 823/1676] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:24.317707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:24.329563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.389086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555a50-1f4a-4883-812f-53e8444aa7d5 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:24.404129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:24.405547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.405928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.406151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.463181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a430414-1466-4803-9776-3934df1a9ee4 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:24.468126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:24.469010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.469289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.469562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.484744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:24.486660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61dbe-ad6b-4ca5-85f7-5934ee29e56c service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:24.524967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 824/1677] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:24.526325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48a03-a880-4f58-ade2-c5380105c75d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.526693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48a03-a880-4f58-ade2-c5380105c75d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.527241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a48a03-a880-4f58-ade2-c5380105c75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.568991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-47a48a03-a880-4f58-ade2-c5380105c75d None None] MFA Rules not processed for user `b642ac529ee043fd894a9188f30ed026`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:24.570684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-47a48a03-a880-4f58-ade2-c5380105c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.583241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:24.585996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:24.608745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 854/1678] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 19:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 19:56:24.618240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:24.624927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.803271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 825/1679] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:24.803271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450d5a8-6860-4237-962a-6e8bd92370f5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.803271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450d5a8-6860-4237-962a-6e8bd92370f5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.803562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450d5a8-6860-4237-962a-6e8bd92370f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.882317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0450d5a8-6860-4237-962a-6e8bd92370f5 None None] MFA Rules not processed for user `0b7dead8216e4cd59eaa15ad8842e38a`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:24.885005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0450d5a8-6860-4237-962a-6e8bd92370f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:24.885932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acefb22-0be0-4418-a88e-589ba40331d6 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:24.905634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:24.911433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:24.911749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:24.912047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] PATH_INFO: `/v3/projects/981b712756ec4b1fa5887b6cf720c8f8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:24.913915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981b712756ec4b1fa5887b6cf720c8f8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:24.915022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: WARNING py.warnings [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 19:56:24.915022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: warnings.warn(msg) May 10 19:56:24.915022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: May 10 19:56:24.916536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:25.077760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981b712756ec4b1fa5887b6cf720c8f8', 'request_id': 'req-aae83e1c-0e32-4573-9c18-a7f01f9d1623'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:25.115876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981b712756ec4b1fa5887b6cf720c8f8', 'request_id': 'req-aae83e1c-0e32-4573-9c18-a7f01f9d1623'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:25.133036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981b712756ec4b1fa5887b6cf720c8f8', 'request_id': 'req-aae83e1c-0e32-4573-9c18-a7f01f9d1623'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:25.145917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 826/1680] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:25.152944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1622-a499-4f48-be54-aa3c347021e7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.156695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1622-a499-4f48-be54-aa3c347021e7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.157093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1622-a499-4f48-be54-aa3c347021e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.158006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] The token cache is being invalidate because project 981b712756ec4b1fa5887b6cf720c8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:25.158494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:25.162316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:25.167815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 855/1681] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:24 2022] DELETE /identity/v3/projects/981b712756ec4b1fa5887b6cf720c8f8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:25.169629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:25.173668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.215644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-30cf1622-a499-4f48-be54-aa3c347021e7 None None] MFA Rules not processed for user `b642ac529ee043fd894a9188f30ed026`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:25.216758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30cf1622-a499-4f48-be54-aa3c347021e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.393791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83e1c-0e32-4573-9c18-a7f01f9d1623 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:25.422134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:25.425617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.428221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.430232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.435358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.455977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 827/1682] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:25.458287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.476073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.477264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.515215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:25.516864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:25.529360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 856/1683] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:25.529879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:25.531388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.540311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:25.541964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.547815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee2b4-92ca-4744-bfb0-f60a4c78a759 service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:25.555159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:25.556186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.556606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.557226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.561972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.610780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:25.619081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c1093-88c2-4cbd-bc6d-ddadace7d92d service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:25.668074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 857/1684] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:25.730516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 828/1685] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:25.735791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.736282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.736792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.818182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:25.823600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:25.875940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 858/1686] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:25.882145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:25.908692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cdf3e-9f94-419d-9658-61f5daa979c6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:25.927710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:25.930182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:25.931900 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:25.935858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:25.936738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:25.938038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:25.943648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:25.980356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 829/1687] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:25.987935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.006326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802a58c-d21e-43df-8612-a4c18701be09 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:26.020328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:26.022303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.023361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.023737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.024933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:26.028483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:26.049055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.051065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.081151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484746-e898-48dd-8b2b-c6dba0161e0a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:26.109083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:26.109083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.109083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.109083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] PATH_INFO: `/v3/users/41841372e4aa4fc081ce994d7ac3a24b` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.111323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] RBAC: Authorizing `identity:delete_user(user_id=41841372e4aa4fc081ce994d7ac3a24b)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:26.113369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:26.127816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 859/1688] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:25 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:26.136966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.139608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.230632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41841372e4aa4fc081ce994d7ac3a24b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.259699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41841372e4aa4fc081ce994d7ac3a24b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.261932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41841372e4aa4fc081ce994d7ac3a24b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.290495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41841372e4aa4fc081ce994d7ac3a24b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.291283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41841372e4aa4fc081ce994d7ac3a24b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.319579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 830/1689] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:26 2022] DELETE /identity/v3/users/41841372e4aa4fc081ce994d7ac3a24b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:26.320980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.331796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.365134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679c3a-5ce5-4e55-936b-6dd619bbbec8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:26.508390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3acca-ff35-47cc-979e-4a6053da423d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:26.539079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:26.542178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:26.542985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.543208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.543323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.543443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.543708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] PATH_INFO: `/v3/projects/aa90dbe567f64d1baef66ee3292ba7fb` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.546950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa90dbe567f64d1baef66ee3292ba7fb)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:26.548528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.549504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:26.551511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:26.577426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034954-5161-4ee9-b66b-754b891a153c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:26.631643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa90dbe567f64d1baef66ee3292ba7fb', 'request_id': 'req-22d2c703-a284-439e-8d4f-a8660163ac9e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.640515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa90dbe567f64d1baef66ee3292ba7fb', 'request_id': 'req-22d2c703-a284-439e-8d4f-a8660163ac9e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.650097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa90dbe567f64d1baef66ee3292ba7fb', 'request_id': 'req-22d2c703-a284-439e-8d4f-a8660163ac9e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.670565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] The token cache is being invalidate because project aa90dbe567f64d1baef66ee3292ba7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:26.670923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.671732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-22d2c703-a284-439e-8d4f-a8660163ac9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:26.678932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 860/1690] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:26 2022] DELETE /identity/v3/projects/aa90dbe567f64d1baef66ee3292ba7fb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:26.680768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.681180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.681525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.685238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 831/1691] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:26 2022] POST /identity/v3/users => generated 282 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:26.697967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.698312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.698621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.701629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:26.703310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.776533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:26.777795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.843916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 861/1692] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:26.845029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.851489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.880415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000dfbf-10a9-4675-b096-238dcf9bfc9e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:26.892404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:26.893172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:26.893471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:26.893826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:26.894515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:26.902582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:26.932063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 862/1693] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:26.936668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.944557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 832/1694] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:26.949394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:26.951005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:26.985306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afdcf0-c47f-46d0-8055-53ab24f10dfa admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.003155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.006101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.008096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.009777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.010216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.018039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea0d6-25ad-4967-8b03-7da8fe29e903 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.073050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 863/1695] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:27.079368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.079677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.082310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.164404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:27.165886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76649d4-a984-4912-9e3e-96cdbd56979d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.169053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:27.194712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.195783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.196148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.196435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.203634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 864/1696] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:27.204148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:27.235601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7bef7-11f9-4f5e-9ddc-747e9f8383d3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.239976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.241756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.264921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.265892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.266173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.266450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] PATH_INFO: `/v3/projects/f224d95a6ce14955b05ad80153aacde6/users/eab4cd2adafa4aa38b5bc562f79e7672/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.302652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 833/1697] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:27.303682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f224d95a6ce14955b05ad80153aacde6, user_id=eab4cd2adafa4aa38b5bc562f79e7672, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.306118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbeb8d7-4c28-4164-9cf2-3118f8556a6a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.306250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:27.339277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 865/1698] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:27 2022] PUT /identity/v3/projects/f224d95a6ce14955b05ad80153aacde6/users/eab4cd2adafa4aa38b5bc562f79e7672/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:27.349269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.349564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.349903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.350222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804eedf-d3ab-4363-83e4-5154c22f187c service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.402080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] MFA Rules not processed for user `eab4cd2adafa4aa38b5bc562f79e7672`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:27.403656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:27.641263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.642011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.642305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.642646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.643805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:27.644119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.647681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.656742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 866/1699] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:27.673949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:27.683733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 834/1700] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:27.690346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:27.718117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3a05-c016-4aa6-a0f4-973364124c23 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.720217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5403d-895c-4ce6-b243-8da98e44ac71 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:27.734001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.734731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.735107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.735392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.736134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.738191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.740300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:27.742213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:27.742213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:27.742213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:27.743972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:27.747223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:27.794744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 835/1701] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:27.798937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:27.834365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 867/1702] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:27.854104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.014793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183670bc-38e0-4bf8-8507-75d8c954db6c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.058128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea970e-f3aa-42e9-a76d-3f10bfbddbfb admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.066508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.068649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.072139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.072589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.073457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.075931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673576f0-f90c-40ea-a478-0f632bc5ff3b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.149475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 868/1703] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:28.152569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.154090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.156006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.206115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:28.210390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:28.249451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.250682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.250682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.250826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.251481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.261645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.335215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 836/1704] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:27 2022] POST /identity/v3/users => generated 287 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:28.336784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.369665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd248e-530e-461c-b9ee-12c04f50b9f4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.383719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 869/1705] 10.222.0.60 () {58 vars in 1015 bytes} [Tue May 10 19:56:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:28.384806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.385739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431082-a855-4550-acaa-854071289400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.389357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431082-a855-4550-acaa-854071289400 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.391584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431082-a855-4550-acaa-854071289400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.393779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37431082-a855-4550-acaa-854071289400 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.398762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37431082-a855-4550-acaa-854071289400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.412057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37431082-a855-4550-acaa-854071289400 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.412781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f44ce-ca95-4f5a-a1a1-ae4ae6d9cb62 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.427964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.428890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.429349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.429958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.431012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.433106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.469059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 870/1706] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:28.469597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 837/1707] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:28.472718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.476615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431082-a855-4550-acaa-854071289400 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.508584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075af8f-647d-4e27-b8f8-12e40b595326 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.529114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.532492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.533508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.533802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.534600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.549914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.553106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37431082-a855-4550-acaa-854071289400 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.571049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.574717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.577502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.577803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] PATH_INFO: `/v3/projects/0d353df66367452dbabf8e990fd6573b/users/825220cec8864f70b9e2696b0d46b054/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.615856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 871/1708] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:28.620108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.654225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fa23-a7e8-40ff-b14a-c42f31578263 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:28.669815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:28.670492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:28.672734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d353df66367452dbabf8e990fd6573b, user_id=825220cec8864f70b9e2696b0d46b054, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.673578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:28.674747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:28.698073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.700929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:28.702415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:28.775204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 838/1709] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:28 2022] PUT /identity/v3/projects/0d353df66367452dbabf8e990fd6573b/users/825220cec8864f70b9e2696b0d46b054/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:28.776888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.798277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 872/1710] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:28.799709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:28.905289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d2624-cee4-46af-a58f-3002262540d8 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:29.096583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ca89-c7e0-4088-b793-0910a178b4c2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:29.115937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:29.120509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:29.120810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:29.121100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] PATH_INFO: `/v3/projects/b5a3bc6f2b1f43b48dc418dfba066489/users/cdfe2a5ca4454d43a75a5d9d58c3fe43/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:29.158529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a3bc6f2b1f43b48dc418dfba066489, user_id=cdfe2a5ca4454d43a75a5d9d58c3fe43, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:29.161991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21a29e-475c-4050-b2b9-d5668ce14672 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:29.188779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 839/1711] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:28 2022] PUT /identity/v3/projects/b5a3bc6f2b1f43b48dc418dfba066489/users/cdfe2a5ca4454d43a75a5d9d58c3fe43/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:29.203142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89466-d065-4dad-bff2-9373144d684b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:29.203515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89466-d065-4dad-bff2-9373144d684b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:29.203715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89466-d065-4dad-bff2-9373144d684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:29.207027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:29.208220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:29.208404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:29.208684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:29.210100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:29.213160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:29.262362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 873/1712] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:29.263765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:29.291424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-16a89466-d065-4dad-bff2-9373144d684b None None] MFA Rules not processed for user `cdfe2a5ca4454d43a75a5d9d58c3fe43`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:29.292750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-16a89466-d065-4dad-bff2-9373144d684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:29.312422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ba20-f647-4ebf-a6d3-4ffe5c88d14a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:29.507422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:29.510802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:29.511332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:29.511821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] PATH_INFO: `/v3/projects/0d353df66367452dbabf8e990fd6573b/users/825220cec8864f70b9e2696b0d46b054/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:29.519373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d353df66367452dbabf8e990fd6573b, user_id=825220cec8864f70b9e2696b0d46b054, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:29.534078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 840/1713] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:29.543872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89466-d065-4dad-bff2-9373144d684b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:29.551806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae618fc6-f4ee-4597-bb89-ed931e88ae0b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:29.590316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89466-d065-4dad-bff2-9373144d684b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:29.590690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 874/1714] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:29 2022] PUT /identity/v3/projects/0d353df66367452dbabf8e990fd6573b/users/825220cec8864f70b9e2696b0d46b054/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:29.602477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:29.603773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:29.605400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:29.744208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] MFA Rules not processed for user `825220cec8864f70b9e2696b0d46b054`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:29.747703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:30.015028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 875/1715] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:30.029359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:30.031834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:30.288678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:30.295237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:30.299042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:30.300333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:30.305161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:30.312502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628854e4-05e9-4469-9d32-0fddccd44297 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:30.314417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120c4b2-1fea-4815-bfe2-ef37e43f92d1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:30.327885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:30.333066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:30.335272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:30.338420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:30.389016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:30.398165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d23be2-efcd-4af3-a265-fc7d0d4b2500 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:30.445794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 841/1716] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:29 2022] POST /identity/v3/projects => generated 373 bytes in 902 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:30.448602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:30.454822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:30.457288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:30.458790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 876/1717] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:30.468797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:30.471460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:30.473077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:30.553486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] MFA Rules not processed for user `2751fce03c284a91b152f545bd8c63ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:30.559707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:30.573442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] MFA Rules not processed for user `b642ac529ee043fd894a9188f30ed026`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:30.580318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:30.854807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 877/1718] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:30.855819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:30.862676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:30.882658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 842/1719] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:30.888998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:30.988065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba013ff-1200-4db3-8edb-f12a971eb517 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.001506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.001506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.001506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.001506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] PATH_INFO: `/v3/projects/f9036a880d834160bb39daa95d3878ae` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.002994 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9036a880d834160bb39daa95d3878ae)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.006171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.078413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9036a880d834160bb39daa95d3878ae', 'request_id': 'req-f8cd03af-8e85-403b-9903-44d762edcbef'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.086586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9036a880d834160bb39daa95d3878ae', 'request_id': 'req-f8cd03af-8e85-403b-9903-44d762edcbef'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.094087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9036a880d834160bb39daa95d3878ae', 'request_id': 'req-f8cd03af-8e85-403b-9903-44d762edcbef'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.127089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] The token cache is being invalidate because project f9036a880d834160bb39daa95d3878ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:31.128359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.133875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.137392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 878/1720] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:30 2022] DELETE /identity/v3/projects/f9036a880d834160bb39daa95d3878ae => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:31.140168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:31.145640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:31.187721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456de8-1496-42da-adc5-dd4cee5746bc None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.341060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd03af-8e85-403b-9903-44d762edcbef admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.345672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.346488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.346881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.347213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.350245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:31.414997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.416313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.416770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.417204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.418061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.420202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.474167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.476581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.491874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 879/1721] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:31.493136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:31.495268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:31.505608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 843/1722] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:30 2022] POST /identity/v3/users => generated 293 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:31.509148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:31.510961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:31.535687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4882-4cde-4e2e-b51e-923828779962 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.540989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90f69-1b24-49d4-8ed4-e506fa28ab13 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.550318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.553098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.553547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.554158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] PATH_INFO: `/v3/users/0dcfe3fcd5144a73b687b3d6f507e0fa` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.560401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.561682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcfe3fcd5144a73b687b3d6f507e0fa)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.561977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.562605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.563123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.564080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.565901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.584078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.589890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 844/1723] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:31.596036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:31.664245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f372e95-856a-4038-bbd1-9057854c8ae4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:31.683885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:31.686178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:31.686669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:31.689901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] PATH_INFO: `/v3/projects/4847e7da7a1e40e786d5edcb43712896/users/839632ab7268487a9af6080f7255f704/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:31.741660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4847e7da7a1e40e786d5edcb43712896, user_id=839632ab7268487a9af6080f7255f704, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:31.753560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:31.795137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcfe3fcd5144a73b687b3d6f507e0fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.814961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 845/1724] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:31 2022] PUT /identity/v3/projects/4847e7da7a1e40e786d5edcb43712896/users/839632ab7268487a9af6080f7255f704/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:31.818023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:31.832357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcfe3fcd5144a73b687b3d6f507e0fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.863008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcfe3fcd5144a73b687b3d6f507e0fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.864873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcfe3fcd5144a73b687b3d6f507e0fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.866432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcfe3fcd5144a73b687b3d6f507e0fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:31.929699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 880/1725] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:31 2022] DELETE /identity/v3/users/0dcfe3fcd5144a73b687b3d6f507e0fa => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:32.028127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510949e-c729-4d2d-8fa4-51b232c16149 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:32.211297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:32.215656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:32.217110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:32.219808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:32.222986 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:32.228904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125bd41-e8c0-4541-8fff-35f3372d790c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:32.279941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 846/1726] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:32.284763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:32.287193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:32.341435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4223281-4802-428b-bf71-8019d7f5d649 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:32.356722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:32.357661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:32.357968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:32.358230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] PATH_INFO: `/v3/projects/4847e7da7a1e40e786d5edcb43712896/users/839632ab7268487a9af6080f7255f704/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:32.377022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4847e7da7a1e40e786d5edcb43712896, user_id=839632ab7268487a9af6080f7255f704, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:32.393391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:32.435619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 881/1727] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:32 2022] PUT /identity/v3/projects/4847e7da7a1e40e786d5edcb43712896/users/839632ab7268487a9af6080f7255f704/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:32.447532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:32.448929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:32.449352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:32.527309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] MFA Rules not processed for user `839632ab7268487a9af6080f7255f704`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:32.528769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:32.756896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 847/1728] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:32.772686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:32.774905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:33.000898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dd803-4432-4d42-bdc3-e567d0946f2c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:33.012353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:33.014333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:33.015404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:33.016744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:33.042096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:33.045753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c9fd2-b6d0-4f79-ac3d-a50d2434e999 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:33.078933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 882/1729] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:33.244613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:33.261045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88099e89-5a11-4780-afe0-9b586cbec366 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:33.275492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:33.278361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:33.279187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:33.280156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:33.285933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:33.478862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:33.484279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef3f55-5a93-46e1-9dc6-f2721ea1b4d4 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:33.563104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 848/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:34.288667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:34.289278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:34.289560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:34.291361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 883/1731] 10.222.0.57 () {54 vars in 912 bytes} [Tue May 10 19:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 19:56:34.316107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b179a-f9bc-42a1-a51d-6a6415a5c0e0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:34.316404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b179a-f9bc-42a1-a51d-6a6415a5c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:34.316735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b179a-f9bc-42a1-a51d-6a6415a5c0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:34.368636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4c4b179a-f9bc-42a1-a51d-6a6415a5c0e0 None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:34.371138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4c4b179a-f9bc-42a1-a51d-6a6415a5c0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:34.559411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 849/1732] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 19:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:34.658532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:34.661523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:34.686553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e595-6dce-4977-a023-1adeb1fc57fd None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:34.687115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e595-6dce-4977-a023-1adeb1fc57fd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:34.687411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e595-6dce-4977-a023-1adeb1fc57fd None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:34.689831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 850/1733] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:56:34.703486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9694f5-7a09-4a3b-b4f8-6a070e4db991 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:34.715691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:34.716647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:34.717148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:34.718792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785018-dec2-4132-a6f3-8f34a09a1817 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:34.719252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785018-dec2-4132-a6f3-8f34a09a1817 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:34.719875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785018-dec2-4132-a6f3-8f34a09a1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:34.725034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:34.771482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:34.772957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:34.788437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-92785018-dec2-4132-a6f3-8f34a09a1817 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:34.789696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-92785018-dec2-4132-a6f3-8f34a09a1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:34.797018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 884/1734] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:34.938259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 851/1735] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:56:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:35.351446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:35.353736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:35.622442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ec3d-f5ef-4c05-ae69-0a2385236d26 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:35.690103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:35.699201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:35.699201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:35.699201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] PATH_INFO: `/v3/projects/7e9f5751e6b141fe911af3b945aaed9a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:35.699658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9f5751e6b141fe911af3b945aaed9a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:35.708834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:35.915628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9f5751e6b141fe911af3b945aaed9a', 'request_id': 'req-edc9e5b1-2aab-4305-a4fb-226b8b21488e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:35.941443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9f5751e6b141fe911af3b945aaed9a', 'request_id': 'req-edc9e5b1-2aab-4305-a4fb-226b8b21488e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:35.986582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9f5751e6b141fe911af3b945aaed9a', 'request_id': 'req-edc9e5b1-2aab-4305-a4fb-226b8b21488e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.083773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] The token cache is being invalidate because project 7e9f5751e6b141fe911af3b945aaed9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:36.084236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.090585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.109929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 885/1736] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:35 2022] DELETE /identity/v3/projects/7e9f5751e6b141fe911af3b945aaed9a => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:36.112473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e028eb-328a-4b87-85b3-7660ec735423 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.113600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e028eb-328a-4b87-85b3-7660ec735423 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.114068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e028eb-328a-4b87-85b3-7660ec735423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.167339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c5e028eb-328a-4b87-85b3-7660ec735423 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:36.171972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c5e028eb-328a-4b87-85b3-7660ec735423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:36.182942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:36.184943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:36.424191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9e5b1-2aab-4305-a4fb-226b8b21488e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:36.435238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 852/1737] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:36.444777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.449269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.452833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.468402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:36.471852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.477034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.479435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] PATH_INFO: `/v3/users/eab4cd2adafa4aa38b5bc562f79e7672` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.487834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab4cd2adafa4aa38b5bc562f79e7672)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:36.490805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:36.527175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:36.531279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:36.593655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 853/1738] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:36.598736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:36.611536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963825a-ae43-44ac-9957-96cf54feced1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:36.640110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:36.640691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.641031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.641321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.649612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:36.650070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:36.652193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:36.685447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 854/1739] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:36.687950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:36.692926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab4cd2adafa4aa38b5bc562f79e7672'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.709854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab4cd2adafa4aa38b5bc562f79e7672'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.721898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800374-1375-40b7-81ee-b7f22d64ddf9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:36.732944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab4cd2adafa4aa38b5bc562f79e7672'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.733859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab4cd2adafa4aa38b5bc562f79e7672'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.734698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-95c1f75e-eccb-4d31-9f33-5c85ea6faef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab4cd2adafa4aa38b5bc562f79e7672'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:36.741250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:36.743134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.746895 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.747356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.748639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:36.751633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:36.820452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 886/1740] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:36 2022] DELETE /identity/v3/users/eab4cd2adafa4aa38b5bc562f79e7672 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:36.822880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:36.823338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:36.825213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:36.839368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 855/1741] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:36 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:36.841878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:36.855282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:36.908933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:36.913190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:37.069866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6e42-3433-4a63-aece-ba2a5acae7d3 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.080142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 887/1742] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:37.088151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.089274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.090307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.090847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.091980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:37.099136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:37.146619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 856/1743] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:36 2022] POST /identity/v3/users => generated 287 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:37.148232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:37.161881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d18678-ab06-48a4-a80e-811ff13a6736 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.168415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.170116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.170760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.171211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.172092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:37.175820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:37.217647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:37.219960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:37.239911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 888/1744] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:37.240997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:37.284613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5afe4e-70bf-4b21-b6f1-e9d697c2edeb admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.305174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.305870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.306152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.306633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.307433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:37.309174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:37.335221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 889/1745] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:37.342908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:37.370139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee812fb0-edb2-407f-b932-c5ca693020db admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.391805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.396345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.396641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.398004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] PATH_INFO: `/v3/projects/0b4be7be08844210b97f8f20b8cb7533/users/8fc6fe7e87c5442090caacab2bde3e08/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.439029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279b505-ad33-499d-b833-43d55fbbc117 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.447920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4be7be08844210b97f8f20b8cb7533, user_id=8fc6fe7e87c5442090caacab2bde3e08, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:37.454438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:37.455719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.456401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.456687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.457028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.475818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:37.490086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 890/1746] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:37 2022] PUT /identity/v3/projects/0b4be7be08844210b97f8f20b8cb7533/users/8fc6fe7e87c5442090caacab2bde3e08/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:37.494802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:37.508511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:37.510388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e40c6-1e7d-4e58-a012-5cbed0087666 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:37.510781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:37.536807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 857/1747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:37.538319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.538643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.538906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.643996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] MFA Rules not processed for user `8fc6fe7e87c5442090caacab2bde3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:37.645797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:37.741045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480bd5-270d-4d38-92f2-30c053226a1c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:37.757624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:37.758254 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:37.758476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:37.758850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:37.863537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 858/1748] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:37.864631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:38.074308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:38.085144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:38.132821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 891/1749] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:38.141454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944f809-1e6a-46e3-9657-57e24ef7e792 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:38.157307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:38.160142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:38.162012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:38.162807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:38.164919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:38.169609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:38.229767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 859/1750] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:37 2022] POST /identity/v3/projects => generated 373 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:38.234413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:38.247109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19e6eb-4f61-407f-b6fa-f79eda9d2910 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:38.439838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:38.441972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:38.446893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:38.447405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:38.448439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:38.452303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:38.504643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 892/1751] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:38 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:38.511589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:38.528132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd6b7-f148-4b17-80b3-6ab157bc6ac7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:38.549796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:38.550693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:38.551096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:38.551576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:38.552388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:38.554146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:38.609836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:38.611691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 860/1752] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:38.626829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f99a4-1c0c-4f5f-9737-3dd83d709ad6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:38.638225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:38.639234 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:38.639721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:38.653858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] PATH_INFO: `/v3/projects/85b20fda12344f66a9de599bf62e671c/users/ff8b060422704209a9028d1d6a07eeed/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:38.725229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b20fda12344f66a9de599bf62e671c, user_id=ff8b060422704209a9028d1d6a07eeed, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:38.729142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafcd83-e075-4bde-949f-24e5afc6b878 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:38.840279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 893/1753] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:38 2022] PUT /identity/v3/projects/85b20fda12344f66a9de599bf62e671c/users/ff8b060422704209a9028d1d6a07eeed/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:38.844169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:38.872869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605746-7fc5-4da1-929f-cf9b24b54351 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:39.012176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.012371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.012679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.072546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:39.073242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.073524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.073801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.074503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] MFA Rules not processed for user `0b7dead8216e4cd59eaa15ad8842e38a`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:39.074637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:39.076353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:39.090571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:39.106904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 861/1754] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:39.107935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:39.128596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8949-dd64-483b-9361-b5767bb39759 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:39.134876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:39.136072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.136541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.137520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] PATH_INFO: `/v3/projects/85b20fda12344f66a9de599bf62e671c/users/ff8b060422704209a9028d1d6a07eeed/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.141515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b20fda12344f66a9de599bf62e671c, user_id=ff8b060422704209a9028d1d6a07eeed, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:39.152520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8b56e-b00a-4ffc-b7c8-c6037010847e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:39.182370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 862/1755] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:39 2022] PUT /identity/v3/projects/85b20fda12344f66a9de599bf62e671c/users/ff8b060422704209a9028d1d6a07eeed/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:39.195556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.196025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.196460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.209803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 894/1756] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:39.271518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] MFA Rules not processed for user `ff8b060422704209a9028d1d6a07eeed`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:39.273326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:39.469947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 863/1757] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:39.507265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:39.508790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:39.568558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:39.570323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:39.668734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a70517-7cd4-4d61-baf7-e7de7e07599d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:39.744246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269703-2bf2-4293-85a1-21ee68d1b157 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:39.755214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:39.756513 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.756901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.757330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] PATH_INFO: `/v3/projects/f224d95a6ce14955b05ad80153aacde6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.768309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f224d95a6ce14955b05ad80153aacde6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:39.771243 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:39.774259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:39.774955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:39.775248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:39.775529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:39.807404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:39.808884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:39.828356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 895/1758] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:39.877429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f224d95a6ce14955b05ad80153aacde6', 'request_id': 'req-b96651aa-f641-45f3-a999-cfcd38fbff4b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:39.905399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f224d95a6ce14955b05ad80153aacde6', 'request_id': 'req-b96651aa-f641-45f3-a999-cfcd38fbff4b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:39.922086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f224d95a6ce14955b05ad80153aacde6', 'request_id': 'req-b96651aa-f641-45f3-a999-cfcd38fbff4b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:39.934420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] The token cache is being invalidate because project f224d95a6ce14955b05ad80153aacde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:39.934791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:39.935456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:39.939987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 864/1759] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:39 2022] DELETE /identity/v3/projects/f224d95a6ce14955b05ad80153aacde6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:39.941659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:39.959673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54bbfb-74a2-4a1f-8101-c48bc748791b service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:40.113192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:40.114368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.115239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.116243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] PATH_INFO: `/v3/users/825220cec8864f70b9e2696b0d46b054` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:40.117689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825220cec8864f70b9e2696b0d46b054)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:40.120049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:40.196740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825220cec8864f70b9e2696b0d46b054'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.211677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825220cec8864f70b9e2696b0d46b054'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.222359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825220cec8864f70b9e2696b0d46b054'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.223736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825220cec8864f70b9e2696b0d46b054'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.224384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-11955ff2-e03e-463a-9f3a-2421ea577072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825220cec8864f70b9e2696b0d46b054'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.247913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 896/1760] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:39 2022] DELETE /identity/v3/users/825220cec8864f70b9e2696b0d46b054 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:40.449066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:40.450574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:40.466337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96651aa-f641-45f3-a999-cfcd38fbff4b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:40.553826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:40.554743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.555024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.555296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] PATH_INFO: `/v3/users/8fc6fe7e87c5442090caacab2bde3e08` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:40.556521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc6fe7e87c5442090caacab2bde3e08)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:40.559285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:40.645951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc6fe7e87c5442090caacab2bde3e08'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.659346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc6fe7e87c5442090caacab2bde3e08'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.660146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc6fe7e87c5442090caacab2bde3e08'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.688405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc6fe7e87c5442090caacab2bde3e08'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.689517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc6fe7e87c5442090caacab2bde3e08'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.707463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 865/1761] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:40 2022] DELETE /identity/v3/users/8fc6fe7e87c5442090caacab2bde3e08 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:40.712635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.713182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.713302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:40.734150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:40.735816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:40.781197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:40.781197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:40.836062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 897/1762] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:40.843633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:40.845219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:40.868755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0806-6f69-40d4-9fb9-ffe44d45c3de admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:40.873457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:40.874631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.874974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.875195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] PATH_INFO: `/v3/projects/0d353df66367452dbabf8e990fd6573b` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:40.876428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d353df66367452dbabf8e990fd6573b)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:40.878635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:40.913730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e61cc-90aa-44b0-bd30-0425cd820b21 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:40.917810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:40.918911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.918911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.919105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:40.928862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:40.930356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa76dad-9907-4d73-bdcb-9a850c7a0c73 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:40.939690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d353df66367452dbabf8e990fd6573b', 'request_id': 'req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.941138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 898/1763] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:40.955100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d353df66367452dbabf8e990fd6573b', 'request_id': 'req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.964807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d353df66367452dbabf8e990fd6573b', 'request_id': 'req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.977305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] The token cache is being invalidate because project 0d353df66367452dbabf8e990fd6573b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:40.977741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.978996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1e462a02-7bc9-41cb-819f-93dc52b1c7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:40.980997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 866/1764] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:40 2022] DELETE /identity/v3/projects/0d353df66367452dbabf8e990fd6573b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:40.986072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:40.986528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:40.986955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.007828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:41.009261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:41.110374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 899/1765] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:41.119785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.120394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.121187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.160516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:41.162045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:41.173126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 867/1766] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:41.177895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.198078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d9809-923a-448b-86d0-287bb19f8473 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.220166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.220938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.221225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.221500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.222563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:41.222909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.228116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.263798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 900/1767] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:41.268261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.285740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7d57-6ac3-4857-ac82-8950601bee67 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.311280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.311960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.312245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.312584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.313321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.318834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.388928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 868/1768] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:41 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:41.392911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.409917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a8438-32a6-4a45-a616-26b57dcebd2e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.442671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.444921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:41.543410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e6801-8d87-4ae9-88d0-bbb989cf9fd2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.558772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.559478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.560025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.560319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.561159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.562034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.563043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.563392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.563500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.563742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] PATH_INFO: `/v3/projects/0b4be7be08844210b97f8f20b8cb7533` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.571617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4be7be08844210b97f8f20b8cb7533)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.573688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.593655 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 901/1769] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:41 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:41.598324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.613660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61794ee-1397-4370-8050-d1d18844ee46 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.621174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.622606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.622999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.623202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.624392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.627620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.651315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 902/1770] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:41.659961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.665048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4be7be08844210b97f8f20b8cb7533', 'request_id': 'req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.672125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4be7be08844210b97f8f20b8cb7533', 'request_id': 'req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.679738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c908c-aa92-4322-b4e7-8eec86cb1e7c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.684678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4be7be08844210b97f8f20b8cb7533', 'request_id': 'req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.708548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] The token cache is being invalidate because project 0b4be7be08844210b97f8f20b8cb7533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:41.709432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.711006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.713019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 869/1771] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:41 2022] DELETE /identity/v3/projects/0b4be7be08844210b97f8f20b8cb7533 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:41.717613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.721941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:41.783122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.783122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.783122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.783122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.784049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.784810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.815341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 903/1772] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:41.820287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:41.825143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:41.857636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389569-fadc-45c6-a5da-c0e6034d93f0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.884896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.885823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.886112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.886389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] PATH_INFO: `/v3/projects/5a832dae98e14d43837a34c99352e6fe/users/2489583a20044473a7700939f9d34265/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.887443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4f16-b9c8-40ec-865d-7bdb7cf006bc admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:41.894281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:41.895832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.896190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.896540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] PATH_INFO: `/v3/users/ff8b060422704209a9028d1d6a07eeed` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.897939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8b060422704209a9028d1d6a07eeed)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.901015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.906847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a832dae98e14d43837a34c99352e6fe, user_id=2489583a20044473a7700939f9d34265, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:41.909914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100165fe-c25d-4f7f-88f6-518c7d6159ab admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:41.937076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 904/1773] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:41 2022] PUT /identity/v3/projects/5a832dae98e14d43837a34c99352e6fe/users/2489583a20044473a7700939f9d34265/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:41.951628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:41.952053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:41.952477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:41.988892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8b060422704209a9028d1d6a07eeed'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.996716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8b060422704209a9028d1d6a07eeed'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.996892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] MFA Rules not processed for user `2489583a20044473a7700939f9d34265`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:41.997586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8b060422704209a9028d1d6a07eeed'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:41.998108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.016723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8b060422704209a9028d1d6a07eeed'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.017436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8b060422704209a9028d1d6a07eeed'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.032833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 870/1774] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:41 2022] DELETE /identity/v3/users/ff8b060422704209a9028d1d6a07eeed => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:42.089901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 905/1775] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:42.094000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.095563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.184800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aefb6-3917-4eef-b909-627a72a0027a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.190596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.191266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.192105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.192387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.193087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.195136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.223686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 871/1776] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:42.227326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.314668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63842a-d7fa-4323-82ed-72caad4b5df6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.398160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.399262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.399660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.400101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.400879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.403089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.439465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.442345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.451207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 906/1777] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:42.454946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.462038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea41c66-20ad-4d59-bf91-f945f6974e43 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.466879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650907-c989-4cbb-adb3-c818c22f0b4c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.469619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.471792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.471792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.471792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] PATH_INFO: `/v3/projects/85b20fda12344f66a9de599bf62e671c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.475020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b20fda12344f66a9de599bf62e671c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.475400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.476168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.476455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.476737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.477747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.477906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.479578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.493669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 907/1778] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:42.497732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.531927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ca59e-5601-4cc3-b5a5-a96485ce0cf3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.565495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b20fda12344f66a9de599bf62e671c', 'request_id': 'req-906dd61b-8562-4a81-81b3-f6a0e5250149'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.590797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b20fda12344f66a9de599bf62e671c', 'request_id': 'req-906dd61b-8562-4a81-81b3-f6a0e5250149'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.607522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b20fda12344f66a9de599bf62e671c', 'request_id': 'req-906dd61b-8562-4a81-81b3-f6a0e5250149'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.660123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] The token cache is being invalidate because project 85b20fda12344f66a9de599bf62e671c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:42.660574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.661145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-906dd61b-8562-4a81-81b3-f6a0e5250149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:42.663865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 872/1779] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:42 2022] DELETE /identity/v3/projects/85b20fda12344f66a9de599bf62e671c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:42.668681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.669885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.669885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.698325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:42.701063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.707836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.708593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.708956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.709788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.710305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.711950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708458eb-6702-4bca-bcaa-b32bd8adf199 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.725863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 873/1780] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:42.733649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.736446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.754740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 908/1781] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:42.756608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.756905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.757238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.765208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c16c3b-22d7-4f4f-ab2d-4c9aebb98d00 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.774963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.775869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.776153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.776431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] PATH_INFO: `/v3/projects/be21a8eb54cb4d65aaf5357b6c53dca9/users/6bef4523da3c4eef8b12ff8df8c1b131/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.778669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:42.780037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.795035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 909/1782] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:42.800372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.804209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be21a8eb54cb4d65aaf5357b6c53dca9, user_id=6bef4523da3c4eef8b12ff8df8c1b131, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.806991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d64e5-c868-4193-b17c-64bfa53af2c8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.812153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595670a7-973c-46c0-875f-c4ec8a6e7d51 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.819826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.821306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.821902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.822620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.823876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:42.824578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:42.826023 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 874/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:42 2022] PUT /identity/v3/projects/be21a8eb54cb4d65aaf5357b6c53dca9/users/6bef4523da3c4eef8b12ff8df8c1b131/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:42.828256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:42.842412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.842864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.843393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:42.845028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 910/1784] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:56:42.860073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:42.881701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec20992-f664-42bb-b167-86fb289d0edc admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:42.923726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] MFA Rules not processed for user `6bef4523da3c4eef8b12ff8df8c1b131`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:42.925875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:42.997865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:42.998981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:42.999451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:42.999741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.000442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.002934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.024921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 875/1785] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:43.025948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.040453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec7f3-45ea-4fb2-a329-5ccf9215ef24 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.046794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.047544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.047933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.048325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.049154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.051398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.065031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 911/1786] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:42 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:43.066150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.089605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 876/1787] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:43.090766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.182408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80959f06-6c0a-4803-ad5f-c43e7e312e3a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.185085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84b09-bad6-4ab1-8089-c4cafd50faa2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.187393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.188063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.188351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.188633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.189341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.192589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.194439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.195576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.196093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.196567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.197483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.199941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.230493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 877/1788] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:43.234276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.240304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 912/1789] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:43.241494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.248068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684936-768e-4571-9fea-24f600136e84 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.254298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.255257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.255698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.256173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.257128 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.260493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.267191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c20e4e-ff16-4e16-ab38-f23ea434ff2a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.277665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 878/1790] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:43.277861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.278397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.278902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.279206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.280200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.282007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.282804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.295777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 913/1791] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:43.300122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.311627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569eac2-38ad-4728-a752-2f721663270f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.317509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aebc1-e7f3-42b8-b5da-2347f697ff91 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.333825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.335214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.335493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.337562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.337562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.337833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.338379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.338601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.339083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] PATH_INFO: `/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1/users/93075b64e35e480781909680aa69b973/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.340363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.358006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 914/1792] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:43.361730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.367309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d851ac65d86e46c7b1d6bf1f0d2ac3b1, user_id=93075b64e35e480781909680aa69b973, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.372466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.375085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62252d-d0e9-4dfa-ae03-0c8b9574bde8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.382052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.382998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.383287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.383566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] PATH_INFO: `/v3/projects/04df2e718c9b4e42a59bac8009cc7968/users/c0ac29a6ed844384ae6a629d34fb483d/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.397233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 879/1793] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:43 2022] PUT /identity/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1/users/93075b64e35e480781909680aa69b973/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:43.398395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.406878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04df2e718c9b4e42a59bac8009cc7968, user_id=c0ac29a6ed844384ae6a629d34fb483d, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.410300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ba749-a739-42b9-a911-c6aecd717986 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.446484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 915/1794] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:43 2022] PUT /identity/v3/projects/04df2e718c9b4e42a59bac8009cc7968/users/c0ac29a6ed844384ae6a629d34fb483d/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:43.457697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.458181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.458503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.485066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3fd29-dbb3-4130-8f08-d4e9b81db5fc admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.488028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] MFA Rules not processed for user `c0ac29a6ed844384ae6a629d34fb483d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:43.490366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:43.549665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.549665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.549665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.549665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.563034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.565249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.595086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 880/1795] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:43.595851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.598718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 916/1796] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:43.599629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.610895 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6b06-b7ec-4cd0-9d45-83e938c3164b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.617793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeec0b-fdac-49be-acae-8a5b2d94a44c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.618153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.619086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.619369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.619641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] PATH_INFO: `/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1/users/93075b64e35e480781909680aa69b973/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.621779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d851ac65d86e46c7b1d6bf1f0d2ac3b1, user_id=93075b64e35e480781909680aa69b973, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.624504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.625515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.626319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.626319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.627041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.627670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a585be2-b5e5-4047-b522-5d68dc97afcf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.629622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.654526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 881/1797] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:43 2022] PUT /identity/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1/users/93075b64e35e480781909680aa69b973/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:43.661386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.661737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.662233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.677018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 917/1798] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:43.681612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.718540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] MFA Rules not processed for user `93075b64e35e480781909680aa69b973`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:43.719881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:43.769275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019a287-9b97-4fb0-80e0-d7a957f89e70 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.775676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.776610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.776742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.776909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.777658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.779831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.802792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 918/1799] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:43.811745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.817581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 882/1800] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:43.824898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.826390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cce67-9d4c-4560-8bc8-a0265a28f1c0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.827649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:43.835621 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.836504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.836892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.837310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.838155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.840018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.859116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 919/1801] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:43.862562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:43.898232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc92f7-18c6-416f-ba42-619dec374d3d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.915583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.917793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.918137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.918371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] PATH_INFO: `/v3/projects/f4d839d6491a4b70bf39008eecc021a1/users/7015f1706618456d872c527f4968b83e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.930889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa6aea-54c6-4b7d-8578-9faad4c024eb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:43.934860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:43.935529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:43.935990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:43.936279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:43.951720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.953932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.957928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d839d6491a4b70bf39008eecc021a1, user_id=7015f1706618456d872c527f4968b83e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:43.965262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:43.987081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 883/1802] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:43.991224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 920/1803] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:43 2022] PUT /identity/v3/projects/f4d839d6491a4b70bf39008eecc021a1/users/7015f1706618456d872c527f4968b83e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:43.995912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:44.031568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713901f-6d3a-4786-863b-742e642d2f9f service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:44.177587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:44.178310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.178632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.178969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.179728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:44.181497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f63f77-2cd8-4dcb-a949-b11c02f9feb2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:44.197014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 884/1804] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:44.199702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:44.216672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36965-ba3a-40b5-a565-c6d3f714ff3c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:44.222049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:44.224083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.224524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.224814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] PATH_INFO: `/v3/projects/f4d839d6491a4b70bf39008eecc021a1/users/7015f1706618456d872c527f4968b83e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.227202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d839d6491a4b70bf39008eecc021a1, user_id=7015f1706618456d872c527f4968b83e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:44.230757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6bb20-0f61-41d8-b3dd-7666db88dd25 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:44.253960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 921/1805] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:44 2022] PUT /identity/v3/projects/f4d839d6491a4b70bf39008eecc021a1/users/7015f1706618456d872c527f4968b83e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:44.256568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.256792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.259909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.297268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74e51-b349-487d-845b-61e728063f83 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.298197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74e51-b349-487d-845b-61e728063f83 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.298827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee74e51-b349-487d-845b-61e728063f83 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.301179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 922/1806] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:56:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:56:44.301366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] MFA Rules not processed for user `7015f1706618456d872c527f4968b83e`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:44.302930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:44.324574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.324938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.325229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.431718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:44.433492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:44.510171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 885/1807] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:44.569571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 923/1808] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:56:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:44.578486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:44.584218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:44.773264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51af9-67bd-4e1d-9e5d-77218c9267d8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:44.788855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:44.792670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.792911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.793204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.824946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:44.826596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:44.840205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:44.842414 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:44.853934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 886/1809] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:44.875399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589460-b881-4b2f-9bc0-a2a20105a409 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:44.895052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:44.897110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:44.897405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:44.897685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:44.923770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:44.926366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:44.948012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:44.949800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:44.966937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 924/1810] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:45.163992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4490d-ac48-4337-8a7a-bb774b44d9d5 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:45.184344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:45.185242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:45.185525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:45.185796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] PATH_INFO: `/v3/users/518a726b993148959be2ff8084809bc5` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:45.192902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518a726b993148959be2ff8084809bc5)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:45.195022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:45.321706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518a726b993148959be2ff8084809bc5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:45.349125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518a726b993148959be2ff8084809bc5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:45.350047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518a726b993148959be2ff8084809bc5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:45.376210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518a726b993148959be2ff8084809bc5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:45.379638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33ab5d81-5c8b-42f2-b180-53d65125c728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518a726b993148959be2ff8084809bc5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:45.418374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 887/1811] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:44 2022] DELETE /identity/v3/users/518a726b993148959be2ff8084809bc5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:45.422348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:45.423287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:45.423722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:45.424187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:45.436596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c89da6-5cbe-4723-88b9-9424c312149e service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:45.452563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:45.454044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:45.560454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 888/1812] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:45.593389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:45.594075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:45.594361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:45.601693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:45.605751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:45.682627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:45.684382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:45.751166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:45.752880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:45.794789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 925/1813] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:45.817244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f47f0-be51-428a-8361-4c86b883ce8c None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:45.854336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:45.855034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:45.855653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:45.861196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:45.907723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:45.909393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4749042-db34-4116-b393-511981aadaf2 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:45.948937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 889/1814] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:47.294834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:47.304012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:47.338869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ae57-9c62-46dc-a073-0c74586d198d service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:47.353670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:47.357812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.359316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.359766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] PATH_INFO: `/v3/projects/997bd75c3a0b4be3a3a4dacac7099774` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.365174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997bd75c3a0b4be3a3a4dacac7099774)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:47.369484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:47.483051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997bd75c3a0b4be3a3a4dacac7099774', 'request_id': 'req-080d5dda-9657-41b3-b111-fcb50daf2514'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:47.497121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997bd75c3a0b4be3a3a4dacac7099774', 'request_id': 'req-080d5dda-9657-41b3-b111-fcb50daf2514'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:47.511300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997bd75c3a0b4be3a3a4dacac7099774', 'request_id': 'req-080d5dda-9657-41b3-b111-fcb50daf2514'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:47.555843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] The token cache is being invalidate because project 997bd75c3a0b4be3a3a4dacac7099774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:47.556313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:47.559466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-080d5dda-9657-41b3-b111-fcb50daf2514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:47.562674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 926/1815] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:47 2022] DELETE /identity/v3/projects/997bd75c3a0b4be3a3a4dacac7099774 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:47.568261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.568735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.570977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.645327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:47.646836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:47.797354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 890/1816] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:47.805338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211983c3-5c51-4a47-8f1e-507639c9a9ef None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.805949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211983c3-5c51-4a47-8f1e-507639c9a9ef None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.806434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211983c3-5c51-4a47-8f1e-507639c9a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.840413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-211983c3-5c51-4a47-8f1e-507639c9a9ef None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:47.841831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-211983c3-5c51-4a47-8f1e-507639c9a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:47.869728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 927/1817] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:47.874931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:47.890045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782529d-bcdf-4192-984b-be1dd9e15f24 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:47.902138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:47.902929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.903212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.903490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.904229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:47.904539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:47.908106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:47.913863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de367d0-a177-4add-901b-7ef06937ed29 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.914157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de367d0-a177-4add-901b-7ef06937ed29 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.914440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de367d0-a177-4add-901b-7ef06937ed29 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.916680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 928/1818] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 19:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 19:56:47.935614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:47.936075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:47.936701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:47.954036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 891/1819] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:47.958604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:47.963388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:47.980389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:47.981456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.016102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8666-91dd-49d7-9518-354f34f43c72 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.039979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.043341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.045322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.046352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] PATH_INFO: `/v3/users/c0ac29a6ed844384ae6a629d34fb483d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.055489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ac29a6ed844384ae6a629d34fb483d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.071942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.179800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ac29a6ed844384ae6a629d34fb483d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:48.189968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ac29a6ed844384ae6a629d34fb483d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:48.190902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ac29a6ed844384ae6a629d34fb483d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:48.210330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ac29a6ed844384ae6a629d34fb483d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:48.211286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-98f8d24e-6071-47d5-aba2-aa5f0564430c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ac29a6ed844384ae6a629d34fb483d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:48.223344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 929/1820] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 19:56:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:48.224419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.226034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.241043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 892/1821] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:47 2022] DELETE /identity/v3/users/c0ac29a6ed844384ae6a629d34fb483d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:48.244008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d177-4c91-4a56-bb5f-e40ffb056418 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.246293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.246800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.247267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.274950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:48.278987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.314694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.315533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.315989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.316986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.317898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.321046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.364153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 930/1822] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:48 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:48.368317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.373360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 893/1823] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:48.442668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a78b1-526d-4fb0-a683-f8db9efa162e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.449682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.450244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.450639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.451657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.452856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.456436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.488693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 931/1824] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:48 2022] POST /identity/v3/users => generated 279 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:48.490353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.505187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ab06d-eb36-44d9-ae9d-9fa3b2653964 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.533585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.534273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.534589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.534892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.536275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.538365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.555439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.559362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.575208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 894/1825] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:48.579553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.598235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb27c1-e604-41e0-a369-d42e2357251a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.607480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.608912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.609367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.609827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.611223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.613281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.625677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 895/1826] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:48.630081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.640996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52d51-c746-41a2-aa91-6fce42ef6b86 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.648959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.650155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.650714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.651199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] PATH_INFO: `/v3/projects/a06adff7f45247a5a4dde2a1339d4e21/users/c78f6b4ccaf4430f8329a869604b0bc2/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.672006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06adff7f45247a5a4dde2a1339d4e21, user_id=c78f6b4ccaf4430f8329a869604b0bc2, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.675729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50aaaa-97dd-4127-89aa-a414b8162a64 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.678331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1960f-6f0e-4628-ae8f-830839925b6a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.688362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.689947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.690228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.690543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.695609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 896/1827] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:48 2022] PUT /identity/v3/projects/a06adff7f45247a5a4dde2a1339d4e21/users/c78f6b4ccaf4430f8329a869604b0bc2/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:48.701299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:48.703003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:48.708264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.708967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.709433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:48.721308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 932/1828] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:48.739387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.740890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.756688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] MFA Rules not processed for user `c78f6b4ccaf4430f8329a869604b0bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:48.758743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:48.861561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665918a1-5fa0-4d6d-92b4-ea079e7f09b7 service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:48.883164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 897/1829] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:48.884650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:48.951190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:48.951897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:48.953439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:48.953748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.023993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921cb9c-0cc1-41e5-a9fc-a698c7121147 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.028806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.029608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.029905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.030188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.031063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.033259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.089790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.091493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.100219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 898/1830] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:48 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:49.101693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.124804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 933/1831] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:49.245467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc07-34c8-4471-86ba-2887d7a60af8 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.256207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.258049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.258353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.258672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.259369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.264774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.311814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 899/1832] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:49 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:49.313574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.327888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497fbf5-464f-4820-b88f-9171ebb2abbb service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.343860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.344842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.346233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.348754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.351281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.353851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.383811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.387312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 934/1833] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:49.405553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff439c75-e904-4296-8198-3c67a17a5a2e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.425386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.427096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.427495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.427781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] PATH_INFO: `/v3/projects/fc1f105e69264c54b1645c399b7902f0/users/e6d764bd7ec54ee2be99d094382874f2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.466328 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1f105e69264c54b1645c399b7902f0, user_id=e6d764bd7ec54ee2be99d094382874f2, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.470002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.488543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 900/1834] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:49 2022] PUT /identity/v3/projects/fc1f105e69264c54b1645c399b7902f0/users/e6d764bd7ec54ee2be99d094382874f2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:49.492950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.509720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1ed6-f1ec-401e-8555-2c6650546094 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.616282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.616980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.617264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.617541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.621737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.624190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61784cf-813d-4362-8133-ac58c29c7315 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.640592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.650526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 935/1835] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:49.653008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785509a-c66b-40ac-8ea5-5e4814614df6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.658559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.659663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.660646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.661062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] PATH_INFO: `/v3/projects/fc1f105e69264c54b1645c399b7902f0/users/e6d764bd7ec54ee2be99d094382874f2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.663335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1f105e69264c54b1645c399b7902f0, user_id=e6d764bd7ec54ee2be99d094382874f2, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.666570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.690488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.691144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.691583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.700241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 901/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:49 2022] PUT /identity/v3/projects/fc1f105e69264c54b1645c399b7902f0/users/e6d764bd7ec54ee2be99d094382874f2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:49.725021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] MFA Rules not processed for user `e6d764bd7ec54ee2be99d094382874f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:49.726405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:49.839813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 936/1837] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:49 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:49.849937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:49.852033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:49.943394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660eec7-1540-4a77-a45c-ccf41eab5a43 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:49.955095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:49.955917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:49.956302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:49.957442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:49.970941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:49.973646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:49.987761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 902/1838] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:50.112728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:50.135686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621673d-fc5d-40e3-88f6-b46d6dca3e4e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:50.148374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:50.148654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:50.148937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:50.149214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:50.233206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:50.234961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:50.301003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:50.303011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:50.317283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 937/1839] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:50.473191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac51a-9d6f-4797-aa01-d3fd54bdd638 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:50.489403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:50.492776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:50.492856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:50.493102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] PATH_INFO: `/v3/projects/04df2e718c9b4e42a59bac8009cc7968` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:50.500411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04df2e718c9b4e42a59bac8009cc7968)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:50.502432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:50.636736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04df2e718c9b4e42a59bac8009cc7968', 'request_id': 'req-4f442c5a-23af-4f04-8cdc-9757d697abb4'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.656308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04df2e718c9b4e42a59bac8009cc7968', 'request_id': 'req-4f442c5a-23af-4f04-8cdc-9757d697abb4'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.664072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04df2e718c9b4e42a59bac8009cc7968', 'request_id': 'req-4f442c5a-23af-4f04-8cdc-9757d697abb4'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.676473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] The token cache is being invalidate because project 04df2e718c9b4e42a59bac8009cc7968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:50.676929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.677592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.679187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 903/1840] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:50 2022] DELETE /identity/v3/projects/04df2e718c9b4e42a59bac8009cc7968 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:50.684163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:50.699477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49275218-8eb3-43af-a609-a44fb710d886 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:50.788958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:50.791168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:50.792597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:50.794388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:50.794722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:50.795000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] PATH_INFO: `/v3/users/7015f1706618456d872c527f4968b83e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:50.796619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7015f1706618456d872c527f4968b83e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:50.798633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:50.868010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7015f1706618456d872c527f4968b83e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.881710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f442c5a-23af-4f04-8cdc-9757d697abb4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:50.881898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7015f1706618456d872c527f4968b83e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.886948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:50.887738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:50.888166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:50.888573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:50.890888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:50.892564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7015f1706618456d872c527f4968b83e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.894650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7015f1706618456d872c527f4968b83e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.896540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7015f1706618456d872c527f4968b83e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:50.937606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 938/1841] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:50 2022] DELETE /identity/v3/users/7015f1706618456d872c527f4968b83e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:50.976845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:50.978434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0547f8e-e88d-4e4c-af9d-5a5137ec3b2b service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:50.990232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 904/1842] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:51.378217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:51.380112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:51.464267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d0e3b-6da4-460d-a819-181259333b35 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:51.470905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:51.472838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:51.473413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:51.473830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] PATH_INFO: `/v3/projects/f4d839d6491a4b70bf39008eecc021a1` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:51.475258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d839d6491a4b70bf39008eecc021a1)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:51.478187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:51.538155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d839d6491a4b70bf39008eecc021a1', 'request_id': 'req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:51.562685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d839d6491a4b70bf39008eecc021a1', 'request_id': 'req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:51.572585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d839d6491a4b70bf39008eecc021a1', 'request_id': 'req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:51.591402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] The token cache is being invalidate because project f4d839d6491a4b70bf39008eecc021a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:51.593408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:51.594291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b69b4ae2-80fd-4b6d-a89c-1e53cfa61284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:51.596425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 939/1843] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:51 2022] DELETE /identity/v3/projects/f4d839d6491a4b70bf39008eecc021a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:51.601186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:51.601477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:51.601757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:51.629282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:51.630544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:51.707518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 905/1844] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:51.715514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:51.716652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:51.717126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:51.741069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:51.743466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:51.766185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 940/1845] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:51.770682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:51.781120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27859873-0fe1-4c2a-88f5-c3b9f3182263 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:51.796816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:51.797462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:51.797882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:51.798179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:51.798964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:51.801287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:51.804661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:51.846176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 906/1846] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:56:51.850350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:51.865059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba83a1-6d7f-4293-bc92-7ddd95be85e6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:51.875353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:51.882400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:51.882769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:51.883247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:51.885536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:51.895420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:51.981519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 941/1847] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:51.981721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:51.993990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dac1f-1396-4fb2-b498-3c593841adab admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.132919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.136142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.140877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.141279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.142241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.144962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.214083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 907/1848] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:51 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:52.218400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.233309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aac98-613b-482e-9c0a-e2ea5422f5d3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.240476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.242542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.244674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.246355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.247649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.250044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.281600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 942/1849] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:52.282531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.306290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d3c56-d602-4679-a9e9-8b88458795da admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.325060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.329426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.329728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.330012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.333938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.338224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d5b72-6e37-45a8-b066-24543092d921 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.392677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 908/1850] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:52.401701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.414804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acdb15-5aa5-4ce4-8911-07980094bee3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.426181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.427899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.428646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.429321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] PATH_INFO: `/v3/projects/4a785d5146444a089527dcbf73dae5d1/users/0df14aa76bc94309b0857bc73845d1d5/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.446998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a785d5146444a089527dcbf73dae5d1, user_id=0df14aa76bc94309b0857bc73845d1d5, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.450263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.470402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 943/1851] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:52 2022] PUT /identity/v3/projects/4a785d5146444a089527dcbf73dae5d1/users/0df14aa76bc94309b0857bc73845d1d5/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:52.482646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.482646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.483006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.553916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] MFA Rules not processed for user `0df14aa76bc94309b0857bc73845d1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:52.555350 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:52.652841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 909/1852] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:52.657317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.742075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b7fd2-9418-43c4-8f0c-34e16cc0b2be admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.748345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.749274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.749554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.749826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.750616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.752531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.783267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 944/1853] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:52 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:52.784511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.795623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615048f4-5bea-430a-a6d1-58c35f35dcf7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.886033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.886742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.887673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.887955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.888652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.890633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.913392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 910/1854] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:52 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:52.918694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.937842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7b92-5a4a-4772-a60b-45c7228e5617 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.944110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.944817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.945133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.945420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.946020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:52.947895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:52.963267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 945/1855] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:52.967671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:52.977961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63496616-653a-4d65-863a-b95acfd40f02 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:52.983026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:52.983965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:52.984249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:52.984521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] PATH_INFO: `/v3/projects/03b54b6ccbe241bc993f2458657ce7ed/users/74faab0880ec48688ea05dff4db94396/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:52.999890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b54b6ccbe241bc993f2458657ce7ed, user_id=74faab0880ec48688ea05dff4db94396, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:53.002567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:53.015843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 911/1856] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:52 2022] PUT /identity/v3/projects/03b54b6ccbe241bc993f2458657ce7ed/users/74faab0880ec48688ea05dff4db94396/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:53.020175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:53.030505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c4133-5822-4983-a101-1eeae7592ced admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:53.090709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:53.091384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.091674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.091959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.092694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:53.094291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a8d1-ae55-480d-89a3-2cafb61612e5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:53.104455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 946/1857] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:53.109175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:53.123363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b2966-8d26-4571-8e39-05bbf314713e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:53.130213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:53.131284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.131647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.132237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] PATH_INFO: `/v3/projects/03b54b6ccbe241bc993f2458657ce7ed/users/74faab0880ec48688ea05dff4db94396/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.134754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b54b6ccbe241bc993f2458657ce7ed, user_id=74faab0880ec48688ea05dff4db94396, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:53.137542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:53.154968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 912/1858] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:53 2022] PUT /identity/v3/projects/03b54b6ccbe241bc993f2458657ce7ed/users/74faab0880ec48688ea05dff4db94396/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:53.165798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.166095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.166381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.203985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] MFA Rules not processed for user `74faab0880ec48688ea05dff4db94396`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:53.205369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:53.276714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 947/1859] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:53.288370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:53.290042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:53.353192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b58c-fd36-4ffa-82ea-954584bb3c21 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:53.357477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:53.358232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.358553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.358985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.369904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:53.371259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d0a09-7411-4ba7-98f3-667ffa52568a service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:53.383846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 913/1860] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:53.413402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:53.493753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8bd0-f6eb-4c51-b7c9-449831e90678 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:53.502714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:53.504619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.504619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.504807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] PATH_INFO: `/v3/users/0df14aa76bc94309b0857bc73845d1d5` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.506411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df14aa76bc94309b0857bc73845d1d5)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:53.508815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:53.583688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df14aa76bc94309b0857bc73845d1d5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:53.592780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df14aa76bc94309b0857bc73845d1d5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:53.604278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df14aa76bc94309b0857bc73845d1d5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:53.605082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df14aa76bc94309b0857bc73845d1d5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:53.606130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df14aa76bc94309b0857bc73845d1d5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:53.659044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 948/1861] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:53 2022] DELETE /identity/v3/users/0df14aa76bc94309b0857bc73845d1d5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:53.660728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:53.661117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:53.661495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:53.697890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:53.699205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:53.820223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 914/1862] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:53.845112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:53.852454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:53.990360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfef60-3817-446e-aa38-68a9c557291f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:54.002560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:54.003250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.004721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.005054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.020261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:54.022555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:54.050685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 949/1863] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:54.517406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:54.519425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.553530 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287728-2d54-49a8-bb39-d2320d810382 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:54.562796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:54.562796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.562796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.562796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] PATH_INFO: `/v3/users/2489583a20044473a7700939f9d34265` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.563324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2489583a20044473a7700939f9d34265)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:54.564528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:54.567075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.567269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:54.587740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672668da-7f70-46bd-87ab-b5b4f398a654 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:54.596952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:54.598710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.599076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.599708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] PATH_INFO: `/v3/projects/4a785d5146444a089527dcbf73dae5d1` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.602000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a785d5146444a089527dcbf73dae5d1)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:54.608422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:54.644611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2489583a20044473a7700939f9d34265'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.653689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2489583a20044473a7700939f9d34265'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.654477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2489583a20044473a7700939f9d34265'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.668395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2489583a20044473a7700939f9d34265'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.669731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f269e01d-2e06-45a7-8355-141b3fe05731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2489583a20044473a7700939f9d34265'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.689519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 915/1864] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:54 2022] DELETE /identity/v3/users/2489583a20044473a7700939f9d34265 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:54.694801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.695092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.695371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.717842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:54.719187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.790347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 916/1865] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:54.801071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:54.802721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.809282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a785d5146444a089527dcbf73dae5d1', 'request_id': 'req-ed64a799-aa51-4731-a201-53ee216460c4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.815854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a785d5146444a089527dcbf73dae5d1', 'request_id': 'req-ed64a799-aa51-4731-a201-53ee216460c4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.822138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a785d5146444a089527dcbf73dae5d1', 'request_id': 'req-ed64a799-aa51-4731-a201-53ee216460c4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.834268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] The token cache is being invalidate because project 4a785d5146444a089527dcbf73dae5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:54.834696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.835311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:54.836856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 950/1866] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:54 2022] DELETE /identity/v3/projects/4a785d5146444a089527dcbf73dae5d1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:54.840910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:54.842321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.862412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53c544-a68d-4746-8a28-70138674af17 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:54.913813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a799-aa51-4731-a201-53ee216460c4 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:54.920761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:54.922211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.922662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.923088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.925283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:54.926669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:54.927804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:54.928152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:54.928518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] PATH_INFO: `/v3/users/74faab0880ec48688ea05dff4db94396` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:54.930099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74faab0880ec48688ea05dff4db94396)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:54.932376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:54.939721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:54.941206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:54.951886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 917/1867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:55.002416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74faab0880ec48688ea05dff4db94396'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:55.014247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74faab0880ec48688ea05dff4db94396'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:55.030114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74faab0880ec48688ea05dff4db94396'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:55.033210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74faab0880ec48688ea05dff4db94396'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:55.034154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74faab0880ec48688ea05dff4db94396'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:55.060766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 951/1868] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:54 2022] DELETE /identity/v3/users/74faab0880ec48688ea05dff4db94396 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:55.700226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:55.702793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:55.729486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042378-b1dd-4f9b-a317-ff6f7ea9fe45 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:55.909088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:55.914406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:55.915285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:55.917068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] PATH_INFO: `/v3/projects/5a832dae98e14d43837a34c99352e6fe` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:55.923261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a832dae98e14d43837a34c99352e6fe)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:55.928575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.007855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a832dae98e14d43837a34c99352e6fe', 'request_id': 'req-aff65359-24e2-46b2-9d6e-225eb5f0d65a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.015073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a832dae98e14d43837a34c99352e6fe', 'request_id': 'req-aff65359-24e2-46b2-9d6e-225eb5f0d65a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.024520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a832dae98e14d43837a34c99352e6fe', 'request_id': 'req-aff65359-24e2-46b2-9d6e-225eb5f0d65a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.040802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] The token cache is being invalidate because project 5a832dae98e14d43837a34c99352e6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:56.041158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.041918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.043616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 918/1869] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:55 2022] DELETE /identity/v3/projects/5a832dae98e14d43837a34c99352e6fe => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:56.047636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.049709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.063616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308b06-cf97-4cec-8a67-e2c067aebea0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.157703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.160784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.167456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.168360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.168644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.168923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] PATH_INFO: `/v3/users/6bef4523da3c4eef8b12ff8df8c1b131` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.170578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bef4523da3c4eef8b12ff8df8c1b131)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.172697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.186231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65359-24e2-46b2-9d6e-225eb5f0d65a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.202173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.203348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.203781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.204208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] PATH_INFO: `/v3/projects/03b54b6ccbe241bc993f2458657ce7ed` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.207595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b54b6ccbe241bc993f2458657ce7ed)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.209806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.241037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bef4523da3c4eef8b12ff8df8c1b131'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.251667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bef4523da3c4eef8b12ff8df8c1b131'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.260631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bef4523da3c4eef8b12ff8df8c1b131'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.261891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bef4523da3c4eef8b12ff8df8c1b131'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.262525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1d87ce54-e305-4708-8e74-8e139cec7e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bef4523da3c4eef8b12ff8df8c1b131'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.281855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 952/1870] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:56 2022] DELETE /identity/v3/users/6bef4523da3c4eef8b12ff8df8c1b131 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:56.290382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b54b6ccbe241bc993f2458657ce7ed', 'request_id': 'req-4a1f9946-5c20-48b8-880a-fba505191ec7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.297047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b54b6ccbe241bc993f2458657ce7ed', 'request_id': 'req-4a1f9946-5c20-48b8-880a-fba505191ec7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.306857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b54b6ccbe241bc993f2458657ce7ed', 'request_id': 'req-4a1f9946-5c20-48b8-880a-fba505191ec7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.317448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] The token cache is being invalidate because project 03b54b6ccbe241bc993f2458657ce7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:56.317866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.318953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4a1f9946-5c20-48b8-880a-fba505191ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.323830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 919/1871] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:56 2022] DELETE /identity/v3/projects/03b54b6ccbe241bc993f2458657ce7ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:56.326193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.326560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.326849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.346026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:56.347840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.410664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 953/1872] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:56.418425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.418760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.419272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.438534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:56.439734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.448812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 920/1873] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:56.453174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.463567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e96bb-9310-45c4-ba4a-2c19cbc8fd2d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.468463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.469138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.469844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.470132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.470907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:56.471214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.472830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.488673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 954/1874] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:56.489547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.501142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd5b7-a190-4871-a6d7-0a2d00a38c33 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.506698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.507360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.507642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.507915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.508604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.510570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.546246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 921/1875] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:56 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:56.547623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.557686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ed51-17c9-48a9-8a44-d8ac5343d3c5 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.622143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.622858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.623202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.623395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.624351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.626884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.629203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.632074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.648941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d27aad-0091-4e26-a6ee-ca16e8c5504f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.655089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.655626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 955/1876] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:56 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:56.656108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.656466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.656800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] PATH_INFO: `/v3/projects/be21a8eb54cb4d65aaf5357b6c53dca9` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.658434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be21a8eb54cb4d65aaf5357b6c53dca9)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.659932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.660884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.678083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff58c8f-155f-4109-83d9-095e7b40fbb8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.684171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.684838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.685118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.685418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.686144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.688293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.700131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 956/1877] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:56.708052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.723010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be21a8eb54cb4d65aaf5357b6c53dca9', 'request_id': 'req-33705912-ae93-48ad-9540-71ce255bb3a1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.727378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e1c1-1ee2-4bf5-b0d9-15eccc20ff0f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.732331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be21a8eb54cb4d65aaf5357b6c53dca9', 'request_id': 'req-33705912-ae93-48ad-9540-71ce255bb3a1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.742835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be21a8eb54cb4d65aaf5357b6c53dca9', 'request_id': 'req-33705912-ae93-48ad-9540-71ce255bb3a1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.757818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] The token cache is being invalidate because project be21a8eb54cb4d65aaf5357b6c53dca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:56.758117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.758823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.760644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 922/1878] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:56 2022] DELETE /identity/v3/projects/be21a8eb54cb4d65aaf5357b6c53dca9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:56.764786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.766540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.804236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.804923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.805277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.805924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.809589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.809589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.822934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 957/1879] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:56.826641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:56.828762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.838473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705912-ae93-48ad-9540-71ce255bb3a1 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.842651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9260-cdaa-47de-8c79-d16bef2f1242 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:56.847221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.847997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:56.848229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.848499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.848774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] PATH_INFO: `/v3/projects/c86c11c429174db8944b695e23f9fcc2/users/09af19573dca40ffa031bc58e9742e83/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.848954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.849241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.849520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] PATH_INFO: `/v3/users/93075b64e35e480781909680aa69b973` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.850974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93075b64e35e480781909680aa69b973)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.852929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.865383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86c11c429174db8944b695e23f9fcc2, user_id=09af19573dca40ffa031bc58e9742e83, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:56.868074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c7eb2-6476-402d-ab67-b2d5bc622843 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:56.881656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 958/1880] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:56 2022] PUT /identity/v3/projects/c86c11c429174db8944b695e23f9fcc2/users/09af19573dca40ffa031bc58e9742e83/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:56.893520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:56.893820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:56.894135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:56.903725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93075b64e35e480781909680aa69b973'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.910642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93075b64e35e480781909680aa69b973'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.912388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93075b64e35e480781909680aa69b973'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.922597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] MFA Rules not processed for user `09af19573dca40ffa031bc58e9742e83`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:56.923846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:56.929943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93075b64e35e480781909680aa69b973'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.930828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93075b64e35e480781909680aa69b973'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:56.954326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 923/1881] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:56:56 2022] DELETE /identity/v3/users/93075b64e35e480781909680aa69b973 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:56:57.000554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 959/1882] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:56:57.005810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.007349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.095904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925ca97-4457-48d9-a65d-be272e5a9419 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.100591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.101251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.101537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.101813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.102563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.104461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.138297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 924/1883] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:57.142596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.207843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46308aa-a44c-4342-aeef-226d054f00b8 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.271911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.275909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.276422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.276527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.276979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.278198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.278306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.281702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.321247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 960/1884] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:57.326791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.328803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60045a4-6ee7-4476-a550-32c452df47ab admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.338073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.339283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.340004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.340140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63686b1d-db21-4586-8340-49e7c948cb75 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.340520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] PATH_INFO: `/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.342925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d851ac65d86e46c7b1d6bf1f0d2ac3b1)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.344854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.346803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.347721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.348070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.348356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.349092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.352802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.369104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 961/1885] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:57.370104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.383656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b5336-7119-4a2c-bf62-45453f365d73 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.389698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.391919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.392239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.392521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] PATH_INFO: `/v3/projects/ce90969da6dc46c08c3baa1632a7b16c/users/be65c5338ed045c89bf399315b3cd06e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.400409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd851ac65d86e46c7b1d6bf1f0d2ac3b1', 'request_id': 'req-36e9ec90-c554-411f-a610-d11fc00b2513'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:57.407695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd851ac65d86e46c7b1d6bf1f0d2ac3b1', 'request_id': 'req-36e9ec90-c554-411f-a610-d11fc00b2513'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:57.410785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90969da6dc46c08c3baa1632a7b16c, user_id=be65c5338ed045c89bf399315b3cd06e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.413663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.419749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd851ac65d86e46c7b1d6bf1f0d2ac3b1', 'request_id': 'req-36e9ec90-c554-411f-a610-d11fc00b2513'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:57.432796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 962/1886] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:57 2022] PUT /identity/v3/projects/ce90969da6dc46c08c3baa1632a7b16c/users/be65c5338ed045c89bf399315b3cd06e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:57.432961 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] The token cache is being invalidate because project d851ac65d86e46c7b1d6bf1f0d2ac3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:56:57.433273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:57.435058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-36e9ec90-c554-411f-a610-d11fc00b2513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:56:57.436631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.438361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.442733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 925/1887] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:56:57 2022] DELETE /identity/v3/projects/d851ac65d86e46c7b1d6bf1f0d2ac3b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:57.444138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6746-4e0b-4d7e-a363-6ba8ede74159 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.444432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6746-4e0b-4d7e-a363-6ba8ede74159 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.444717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde6746-4e0b-4d7e-a363-6ba8ede74159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.465551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0bde6746-4e0b-4d7e-a363-6ba8ede74159 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:57.466932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0bde6746-4e0b-4d7e-a363-6ba8ede74159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.533084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482b9fd-ecae-4c8a-b779-9dc238adaa0b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.539304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.540039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.540455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.540809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.541202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 926/1888] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:57.547224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.555240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.557871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.558159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.559158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.573082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 963/1889] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:57.575037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.585175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7bef3-b816-4776-aff5-70edb54277f6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.591986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.592989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.593348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.593695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] PATH_INFO: `/v3/projects/ce90969da6dc46c08c3baa1632a7b16c/users/be65c5338ed045c89bf399315b3cd06e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.596371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90969da6dc46c08c3baa1632a7b16c, user_id=be65c5338ed045c89bf399315b3cd06e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.599040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:57.599759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9948-1ac1-42e0-9264-b88172f98a8d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.601095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.611168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 964/1890] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:57 2022] PUT /identity/v3/projects/ce90969da6dc46c08c3baa1632a7b16c/users/be65c5338ed045c89bf399315b3cd06e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:57.622282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.622603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.623207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.652471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] MFA Rules not processed for user `be65c5338ed045c89bf399315b3cd06e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:57.653692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.723285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 927/1891] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:57.725220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.740358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14e00f-2930-48a1-a3b4-7ad612649ce3 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.750803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.752398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.752890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.754018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.755198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:56:57.755807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.757742 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.771552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 965/1892] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:57.797208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 928/1893] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:56:57.801935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.803549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:57.805933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.834050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81102-f611-45b2-a7fa-c76312ede1f7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.850604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.851252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.851541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.851810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.852679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.858190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:57.896476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 929/1894] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:57.901514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:57.930650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cd388-4ce4-4e20-9378-2ac68302328f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.985875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae89f-9393-47d7-9d67-541a0eaaa5e7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:57.991692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:57.991871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:57.992118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:57.992406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:57.993205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:57.995502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.027304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 930/1895] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:57 2022] POST /identity/v3/users => generated 305 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:58.029049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.040689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.040689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.040689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.040689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.044353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f993ff5-8f2e-4913-8698-b3daf7ffbadb admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.053632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.054353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.054670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.054952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.055844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.057919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.077222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 931/1896] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:58.078996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.093406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21685fa-204a-46c0-8623-319468b25b58 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.101429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.102177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.102737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.103086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.104179 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.106076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.122222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 932/1897] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:56:58.128726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.143213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596db5-a78c-4d96-a8e7-7312f5dbb474 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.152283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.153420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.153770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.154302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] PATH_INFO: `/v3/projects/56f73f6841c84fd2b7f6256e849928e7/users/99428ccba30441baa809a78cbed7d947/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.176704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f73f6841c84fd2b7f6256e849928e7, user_id=99428ccba30441baa809a78cbed7d947, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.180330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86162e9c-29c9-4b60-88dc-65962de36675 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.202287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 933/1898] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:58 2022] PUT /identity/v3/projects/56f73f6841c84fd2b7f6256e849928e7/users/99428ccba30441baa809a78cbed7d947/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:58.203174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.204654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.213725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.214659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.214947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.242247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 966/1899] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:58.283979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] MFA Rules not processed for user `99428ccba30441baa809a78cbed7d947`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:58.289465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:58.395968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 934/1900] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:58.400355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.414547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230232-1b65-45ec-b170-90c3d85ecd4c service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.480085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.481671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:58.482928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.486678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.496953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.497991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.499022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.502579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.548314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 967/1901] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:56:58 2022] POST /identity/v3/projects => generated 409 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:56:58.552578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.600008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87d08b-add2-4417-ad1f-18ef2aaee207 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.631537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b6afa-1efe-46f5-bbd4-ff17aa11d776 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.638657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.639692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.639692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.639901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.640599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.642579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.668322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 968/1902] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:56:58 2022] POST /identity/v3/users => generated 311 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:56:58.672466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.674396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.675395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.675826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.676272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.678558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:58.686787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec5bd-8dd6-433a-b880-adee59aa138a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.692789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.693535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.693824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.694103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.694978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.696688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.713597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 969/1903] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:58.718390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.732422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d8e7-3880-4c89-99db-c2b6b94ffa28 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.738645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.740144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.740771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.741216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] PATH_INFO: `/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8/users/043eb3b2a9914d6392fb4fd54aa08c09/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.760520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7609db58d5fd4ecaa1faadc17dd69fe8, user_id=043eb3b2a9914d6392fb4fd54aa08c09, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.760771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.763012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.763369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.778425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 935/1904] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:56:58.791508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 970/1905] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:58 2022] PUT /identity/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8/users/043eb3b2a9914d6392fb4fd54aa08c09/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:58.792650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.807723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ae6e3-749d-4c6d-9533-48339ce79397 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.891230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.892105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.892364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.892629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.893334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.895935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56da16c-341b-44a4-9ee4-3071d6f0242a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.916548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:58.937076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89641a-01a6-4f59-9ef8-1833755c99f9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:58.937772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 936/1906] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:56:58.943130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:58.944092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.944381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.944661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] PATH_INFO: `/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8/users/043eb3b2a9914d6392fb4fd54aa08c09/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.946788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7609db58d5fd4ecaa1faadc17dd69fe8, user_id=043eb3b2a9914d6392fb4fd54aa08c09, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:58.949457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:58.976632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:58.976925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:58.977215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:58.979129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 971/1907] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:56:58 2022] PUT /identity/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8/users/043eb3b2a9914d6392fb4fd54aa08c09/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:56:59.016949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] MFA Rules not processed for user `043eb3b2a9914d6392fb4fd54aa08c09`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:56:59.018311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:56:59.095180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 937/1908] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:56:59.108689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:59.180652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746dbce-72a1-4b18-a731-2a913432f927 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:59.188905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:59.189803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:59.190101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:59.190360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:59.203108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:59.204566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:59.217611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 972/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:56:59.397125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:56:59.406365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e18aab-ed49-4162-b021-0998fa04a4c2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:56:59.410178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:56:59.410859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:56:59.411205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:56:59.411485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:56:59.466502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:56:59.467939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114565-6e56-4f7d-be17-14e3e8dea964 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:56:59.476726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 938/1910] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:11.103833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:11.180626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a03b-ace0-42d0-b897-709e27759e28 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:11.185691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:11.186574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:11.186856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:11.187131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] PATH_INFO: `/v3/users/09af19573dca40ffa031bc58e9742e83` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:11.188315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09af19573dca40ffa031bc58e9742e83)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:11.190237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:11.236945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09af19573dca40ffa031bc58e9742e83'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.244816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09af19573dca40ffa031bc58e9742e83'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.252165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09af19573dca40ffa031bc58e9742e83'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.252795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09af19573dca40ffa031bc58e9742e83'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.253971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09af19573dca40ffa031bc58e9742e83'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.270556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 973/1911] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:11 2022] DELETE /identity/v3/users/09af19573dca40ffa031bc58e9742e83 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:11.275777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:11.276297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:11.276387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:11.293438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:11.294665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:11.354697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 939/1912] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:11.364500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:11.365955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:11.433671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bbdf8-0943-4611-b628-d13deae8639d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:11.438083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:11.438810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:11.439090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:11.439363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:11.449827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:11.451305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:11.462957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 974/1913] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:11.776031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:11.777527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:11.789769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15fbed-2565-4870-96ca-06cd8e044ca5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:11.795130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:11.795939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:11.796348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:11.796635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] PATH_INFO: `/v3/projects/c86c11c429174db8944b695e23f9fcc2` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:11.798596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86c11c429174db8944b695e23f9fcc2)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:11.801349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:11.881726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86c11c429174db8944b695e23f9fcc2', 'request_id': 'req-3c75057d-6ffe-4d29-9007-68117f7c2be2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.888537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86c11c429174db8944b695e23f9fcc2', 'request_id': 'req-3c75057d-6ffe-4d29-9007-68117f7c2be2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.904915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86c11c429174db8944b695e23f9fcc2', 'request_id': 'req-3c75057d-6ffe-4d29-9007-68117f7c2be2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.949970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] The token cache is being invalidate because project c86c11c429174db8944b695e23f9fcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:11.950410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.951398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:11.953533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 940/1914] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:11 2022] DELETE /identity/v3/projects/c86c11c429174db8944b695e23f9fcc2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:11.957328 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:11.968938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20a88-d83e-423f-8f01-9758d8ad1d73 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:12.043549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:12.044972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:12.045500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:12.046001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] PATH_INFO: `/v3/users/be65c5338ed045c89bf399315b3cd06e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:12.047781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be65c5338ed045c89bf399315b3cd06e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:12.050368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:12.110589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be65c5338ed045c89bf399315b3cd06e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.120100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be65c5338ed045c89bf399315b3cd06e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.133708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be65c5338ed045c89bf399315b3cd06e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.134528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be65c5338ed045c89bf399315b3cd06e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.135505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8b2c3910-d30b-46e2-8153-ed687134015a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be65c5338ed045c89bf399315b3cd06e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.174807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 975/1915] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:11 2022] DELETE /identity/v3/users/be65c5338ed045c89bf399315b3cd06e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:12.695572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:12.698027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:12.714579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75057d-6ffe-4d29-9007-68117f7c2be2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:12.780418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:12.781281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:12.781554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:12.781836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] PATH_INFO: `/v3/projects/ce90969da6dc46c08c3baa1632a7b16c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:12.783071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90969da6dc46c08c3baa1632a7b16c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:12.784995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:12.832932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90969da6dc46c08c3baa1632a7b16c', 'request_id': 'req-0380d76c-12e9-400b-a5c5-7746404ec30f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.839333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90969da6dc46c08c3baa1632a7b16c', 'request_id': 'req-0380d76c-12e9-400b-a5c5-7746404ec30f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.847204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90969da6dc46c08c3baa1632a7b16c', 'request_id': 'req-0380d76c-12e9-400b-a5c5-7746404ec30f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.857475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] The token cache is being invalidate because project ce90969da6dc46c08c3baa1632a7b16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:12.857770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.858386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0380d76c-12e9-400b-a5c5-7746404ec30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:12.859987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 941/1916] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:12 2022] DELETE /identity/v3/projects/ce90969da6dc46c08c3baa1632a7b16c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:12.866287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:12.866636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:12.866923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:12.886795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:12.887985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:12.948318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 976/1917] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:12.957433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:12.957433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:12.957619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:12.978902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:12.984994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:12.995261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 942/1918] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:12.999572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.012221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f4e1-40a7-4fdb-8b90-1dd9a95c3e3e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.017939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.018853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.019311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.019766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.020772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:13.021351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.023439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.043831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 977/1919] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:13.048336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.059036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c96fb-c36e-4869-91a4-16cd0689ab66 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.064317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.064980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.065362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.065758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.067455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.068428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.110834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 943/1920] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:13.116714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.140230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22232f-4384-4606-a930-d0bca7af2236 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.196437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.199054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:13.215857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.216652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.216936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.217241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.218057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.220194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.251320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 978/1921] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:13.254962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.267237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893754-9696-4fb7-bac7-0f0f158625a0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.276628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.277678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.278163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.278536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.279386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.282357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.285991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcd95e-4294-4fa4-a0a1-2b94e58dad45 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.291569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.293850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.295587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 979/1922] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:13.298827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.299306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] PATH_INFO: `/v3/users/99428ccba30441baa809a78cbed7d947` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.299560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.302142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99428ccba30441baa809a78cbed7d947)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.304440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.314813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323a4e-fbbf-47fc-bb7c-6d4f094cf364 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.327931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.328605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.329066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.329500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.330376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.333090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.350779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 980/1923] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:13.355423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.360476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99428ccba30441baa809a78cbed7d947'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:13.368060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ca337-0cb4-439b-8c84-73840920d7b9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.368576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99428ccba30441baa809a78cbed7d947'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:13.369495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99428ccba30441baa809a78cbed7d947'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:13.374640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.375712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.376291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.376712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] PATH_INFO: `/v3/projects/1796d8b5031d446783de1d34605ab175/users/ee45a0f7e6fd42fbb258ae6a3487f438/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.382512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99428ccba30441baa809a78cbed7d947'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:13.383363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81b4416e-881c-4615-923a-1bb66df04290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99428ccba30441baa809a78cbed7d947'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:13.395605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1796d8b5031d446783de1d34605ab175, user_id=ee45a0f7e6fd42fbb258ae6a3487f438, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.398985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283c910-0141-4688-b1c5-c6b2fee6a002 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.400382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 944/1924] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:13 2022] DELETE /identity/v3/users/99428ccba30441baa809a78cbed7d947 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:13.404693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.404959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.405239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.415296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 981/1925] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:13 2022] PUT /identity/v3/projects/1796d8b5031d446783de1d34605ab175/users/ee45a0f7e6fd42fbb258ae6a3487f438/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:13.425670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:13.426416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.426861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.427298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:13.427434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.465639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] MFA Rules not processed for user `ee45a0f7e6fd42fbb258ae6a3487f438`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:13.468853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:13.526339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 945/1926] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:13.539682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.541116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:13.618333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 982/1927] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:13.619681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355715-b742-4325-bd0d-6993dc3561bc None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.622121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.624069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:13.635891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.636582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.636871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.637184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.648119 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.648509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afd6a0-3963-4dc4-9a36-f634680537cc None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.649589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.660038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.660822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.661177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.661518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.662291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.664516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.665735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 946/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:13.701581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 983/1929] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:13.704517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.718325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28af3-4580-43a3-9c1f-f46773c7a10b service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.814250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.816166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.816166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.816166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.818583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.823553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.862267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 947/1930] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:13 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:13.866634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.879441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4a02b-37f7-4f97-b524-802ff833924f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.885124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.885988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.886278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.886673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.887757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.889776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:13.903942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 984/1931] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:13.908302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:13.921973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa0a62-2459-480a-a8a9-8c87a3476670 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:13.934407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:13.937839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:13.937839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:13.939340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] PATH_INFO: `/v3/projects/7a91c03cc64a4059847caa954af234cd/users/a41fa0ef56ab44b5bbec496e428082d2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:13.982056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a91c03cc64a4059847caa954af234cd, user_id=a41fa0ef56ab44b5bbec496e428082d2, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:13.995584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.011591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 948/1932] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:13 2022] PUT /identity/v3/projects/7a91c03cc64a4059847caa954af234cd/users/a41fa0ef56ab44b5bbec496e428082d2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:14.013316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:14.026287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddba37-e7da-4bf4-8616-8257d6785465 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:14.120977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:14.121860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.122173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.122583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.123777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:14.126110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.139182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 985/1933] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:14.143872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:14.155472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1799-8e2c-4d6e-96a9-e32c6d520624 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:14.161583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:14.162577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.162942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.163321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] PATH_INFO: `/v3/projects/7a91c03cc64a4059847caa954af234cd/users/a41fa0ef56ab44b5bbec496e428082d2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.165651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a91c03cc64a4059847caa954af234cd, user_id=a41fa0ef56ab44b5bbec496e428082d2, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:14.169014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30b583-22bd-47df-afdc-ba0590530754 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.173958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:14.177888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:14.182842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 949/1934] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:14 2022] PUT /identity/v3/projects/7a91c03cc64a4059847caa954af234cd/users/a41fa0ef56ab44b5bbec496e428082d2/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:14.193041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.193472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.193857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.204022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a8c33-b04a-4161-8dee-43d5beec93ae admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:14.239658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] MFA Rules not processed for user `a41fa0ef56ab44b5bbec496e428082d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:14.240888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:14.272184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:14.273087 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.273368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.273638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] PATH_INFO: `/v3/projects/56f73f6841c84fd2b7f6256e849928e7` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.275441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f73f6841c84fd2b7f6256e849928e7)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:14.277729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.340564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f73f6841c84fd2b7f6256e849928e7', 'request_id': 'req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.343609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 950/1935] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:14.350164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f73f6841c84fd2b7f6256e849928e7', 'request_id': 'req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.355453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:14.357041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:14.357684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f73f6841c84fd2b7f6256e849928e7', 'request_id': 'req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.374620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] The token cache is being invalidate because project 56f73f6841c84fd2b7f6256e849928e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:14.375031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.375784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.378753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 986/1936] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:14 2022] DELETE /identity/v3/projects/56f73f6841c84fd2b7f6256e849928e7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:14.382556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:14.383970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:14.426511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979e05-cb1c-4abc-b5d1-17622299c0eb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:14.454200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dcecc-b4ee-42b0-91a3-dfd31b15a941 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:14.459255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:14.460152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.460484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.460760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] PATH_INFO: `/v3/users/043eb3b2a9914d6392fb4fd54aa08c09` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.462791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=043eb3b2a9914d6392fb4fd54aa08c09)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:14.465005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.489338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:14.490166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:14.490698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:14.491397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:14.493807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:14.536173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043eb3b2a9914d6392fb4fd54aa08c09'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.546960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043eb3b2a9914d6392fb4fd54aa08c09'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.555672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043eb3b2a9914d6392fb4fd54aa08c09'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.556324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043eb3b2a9914d6392fb4fd54aa08c09'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.556964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043eb3b2a9914d6392fb4fd54aa08c09'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:14.571670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:14.573106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:14.587764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 951/1937] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:14.601827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 987/1938] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:14 2022] DELETE /identity/v3/users/043eb3b2a9914d6392fb4fd54aa08c09 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:15.089703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:15.091711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.107966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97437-445b-4215-a30f-7991e38087ec service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:15.183941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:15.184830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.185191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.185411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] PATH_INFO: `/v3/users/c78f6b4ccaf4430f8329a869604b0bc2` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.188393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78f6b4ccaf4430f8329a869604b0bc2)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:15.190030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:15.263478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:15.263478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.291678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d552-2ec0-44c6-8b29-d3020f826c6f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:15.304259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:15.305474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.305904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.306341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] PATH_INFO: `/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.306484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78f6b4ccaf4430f8329a869604b0bc2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.307857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7609db58d5fd4ecaa1faadc17dd69fe8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:15.309979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:15.317112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78f6b4ccaf4430f8329a869604b0bc2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.318098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78f6b4ccaf4430f8329a869604b0bc2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.351862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78f6b4ccaf4430f8329a869604b0bc2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.353056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bfeab2a7-e021-44c0-97a6-9934880fb866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78f6b4ccaf4430f8329a869604b0bc2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.378176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 952/1939] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:15 2022] DELETE /identity/v3/users/c78f6b4ccaf4430f8329a869604b0bc2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:15.383205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088214d-1a66-4517-bc74-43b25c51e183 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.383662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088214d-1a66-4517-bc74-43b25c51e183 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.384222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088214d-1a66-4517-bc74-43b25c51e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.438697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8088214d-1a66-4517-bc74-43b25c51e183 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:15.442968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7609db58d5fd4ecaa1faadc17dd69fe8', 'request_id': 'req-6546fad3-deb5-4ff8-8c7a-d52d33a64205'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.454655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8088214d-1a66-4517-bc74-43b25c51e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.465562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7609db58d5fd4ecaa1faadc17dd69fe8', 'request_id': 'req-6546fad3-deb5-4ff8-8c7a-d52d33a64205'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.472910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7609db58d5fd4ecaa1faadc17dd69fe8', 'request_id': 'req-6546fad3-deb5-4ff8-8c7a-d52d33a64205'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.487710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] The token cache is being invalidate because project 7609db58d5fd4ecaa1faadc17dd69fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:15.488404 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.489740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.492547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 988/1940] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:15 2022] DELETE /identity/v3/projects/7609db58d5fd4ecaa1faadc17dd69fe8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:15.493746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:15.499137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.636011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 953/1941] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:15.637491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.637783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.639804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.672547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:15.673779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.678945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fad3-deb5-4ff8-8c7a-d52d33a64205 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:15.683061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 954/1942] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:15.686098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:15.687201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.687619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.688144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] PATH_INFO: `/v3/users/ee45a0f7e6fd42fbb258ae6a3487f438` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.689566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee45a0f7e6fd42fbb258ae6a3487f438)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:15.690214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:15.691721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.693274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:15.760489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee45a0f7e6fd42fbb258ae6a3487f438'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.761361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db312-d304-4a3a-b7c1-71d50e228b57 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:15.765733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:15.766540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.766831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.767106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.772182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee45a0f7e6fd42fbb258ae6a3487f438'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.780046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:15.781618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58384c-69c6-4a07-892b-7aa24a31fd70 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:15.784761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee45a0f7e6fd42fbb258ae6a3487f438'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.786651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee45a0f7e6fd42fbb258ae6a3487f438'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.788977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e09aa131-1b80-412e-afcf-49bb52e806be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee45a0f7e6fd42fbb258ae6a3487f438'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:15.798414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 955/1943] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:15.799548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.799843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.800508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.823746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:15.824840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.834999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 989/1944] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:15 2022] DELETE /identity/v3/users/ee45a0f7e6fd42fbb258ae6a3487f438 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:15.836129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.838590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.838983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.839350 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 956/1945] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:15.843105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:15.856955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93eb2e-8a01-49b7-9392-0b3d6b3ce610 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:15.873212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:15.876274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:15.978224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 990/1946] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:15.978759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:15.979602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:15.979893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:15.980309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:15.981808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:15.981808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:15.983874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.004368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 957/1947] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:57:16.004649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.015198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b9847-787f-4e03-a560-c7d11b730989 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.021439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.022124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.022413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.022723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.023090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.030096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.035704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.037712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.095748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 991/1948] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:16.097467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.113476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6c60-34d9-4bac-ae0d-f6d088b7f3ba admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.212104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.212896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2ac84-792a-4064-b594-716aedba9a86 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.213132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.213564 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.214099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.218268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.219044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.219332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.219606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.220434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.223177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.225750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.227438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.241263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 958/1949] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:16.250383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.253516 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.257889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 992/1950] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:16 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:16.259097 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.272402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948eceb-25ab-42c8-99bf-3d0ac43ee95b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.276351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775a3c-b9cf-4d49-b697-ef069215b6ba service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.278187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.279045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.279451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.279831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.280758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.282871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.283663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.286805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.287286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.287765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] PATH_INFO: `/v3/projects/a06adff7f45247a5a4dde2a1339d4e21` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.289236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06adff7f45247a5a4dde2a1339d4e21)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.291595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.295491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 993/1951] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:16.299995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.313864 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530e8c-c85f-4643-b671-467ba3b8c3bb admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.319273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.320243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.320604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.320954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.321806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.323595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.341124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 994/1952] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:16.345200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.357916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0d78-2a9b-4ed0-9a86-812d708c0015 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.370357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06adff7f45247a5a4dde2a1339d4e21', 'request_id': 'req-148d59e5-24a8-44a1-af81-bf9593f3f699'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.378258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06adff7f45247a5a4dde2a1339d4e21', 'request_id': 'req-148d59e5-24a8-44a1-af81-bf9593f3f699'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.386973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06adff7f45247a5a4dde2a1339d4e21', 'request_id': 'req-148d59e5-24a8-44a1-af81-bf9593f3f699'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.412617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] The token cache is being invalidate because project a06adff7f45247a5a4dde2a1339d4e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:16.412934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.413617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.415964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 959/1953] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:16 2022] DELETE /identity/v3/projects/a06adff7f45247a5a4dde2a1339d4e21 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:16.420396 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.421778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.448313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.449211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.449490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.449819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] PATH_INFO: `/v3/projects/7aeb98877d59446aa1f1d684fde50349/users/b281ae272c5542eaa3ae7620bf68a041/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.469790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aeb98877d59446aa1f1d684fde50349, user_id=b281ae272c5542eaa3ae7620bf68a041, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.473666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d9afd-51d2-4ba9-9f23-564ea262e837 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.490702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 995/1954] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:16 2022] PUT /identity/v3/projects/7aeb98877d59446aa1f1d684fde50349/users/b281ae272c5542eaa3ae7620bf68a041/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:16.506986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.507285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.507568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.517275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d59e5-24a8-44a1-af81-bf9593f3f699 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.547480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] MFA Rules not processed for user `b281ae272c5542eaa3ae7620bf68a041`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:16.549075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.596451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.598080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.598482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.598862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] PATH_INFO: `/v3/users/e6d764bd7ec54ee2be99d094382874f2` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.600851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d764bd7ec54ee2be99d094382874f2)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.603414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.632189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 996/1955] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:16.637861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.639541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.654350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb072-acb8-408c-9500-b989cfdbe141 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.659244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.662079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d764bd7ec54ee2be99d094382874f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.662577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.663032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.663727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.664484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.668282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.676110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d764bd7ec54ee2be99d094382874f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.676831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d764bd7ec54ee2be99d094382874f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.694589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d764bd7ec54ee2be99d094382874f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.695473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d764bd7ec54ee2be99d094382874f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.701291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 997/1956] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:16 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:16.702209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.704050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.715003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 960/1957] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:16 2022] DELETE /identity/v3/users/e6d764bd7ec54ee2be99d094382874f2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:16.719718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.721277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:16.775513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500d7b0-5ed3-421f-a74c-ec98059c44f8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.796547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdcc32-56a1-4073-8c9c-22b4cbed454b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.803844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.805296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.805296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.805648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.806797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.809406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.843312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 961/1958] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:16 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:16.847846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.860886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.862944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.863688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.863973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] PATH_INFO: `/v3/projects/1796d8b5031d446783de1d34605ab175` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.864229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffd2da-b928-4253-b526-fd61faf5af17 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.865860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1796d8b5031d446783de1d34605ab175)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.868223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.870005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.870881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.871315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.871741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.872645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.874822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.888518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 962/1959] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:16.889424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.899827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57138aa0-4bb5-428f-bb29-2b2af8756606 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:16.905526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:16.906493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:16.908155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:16.908155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] PATH_INFO: `/v3/projects/edf92df087cc4f4695f2ca8c59508a6f/users/4855cc3edfaf49afb114b91e5661f05c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:16.925779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf92df087cc4f4695f2ca8c59508a6f, user_id=4855cc3edfaf49afb114b91e5661f05c, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:16.928945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:16.935561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1796d8b5031d446783de1d34605ab175', 'request_id': 'req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.943649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1796d8b5031d446783de1d34605ab175', 'request_id': 'req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.944306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 963/1960] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:16 2022] PUT /identity/v3/projects/edf92df087cc4f4695f2ca8c59508a6f/users/4855cc3edfaf49afb114b91e5661f05c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:16.948322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.950954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1796d8b5031d446783de1d34605ab175', 'request_id': 'req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.973038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] The token cache is being invalidate because project 1796d8b5031d446783de1d34605ab175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:16.973460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.974229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:16.976180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 998/1961] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:16 2022] DELETE /identity/v3/projects/1796d8b5031d446783de1d34605ab175 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:16.988922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:16.995590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.028142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541bdbb-7d3e-46cf-921e-9572d23fe082 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.033728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.035092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.035372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.035743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.036421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.038060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.048973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 964/1962] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:17.053200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.055114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.067147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda3ce-6aad-4048-823a-d7c4a7a73c9c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.069476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cb0-7ab1-4deb-88c6-dc89f67ea37f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.073031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.074337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.074679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.075043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.075418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] PATH_INFO: `/v3/users/a41fa0ef56ab44b5bbec496e428082d2` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.075656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.075998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.076334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] PATH_INFO: `/v3/projects/edf92df087cc4f4695f2ca8c59508a6f/users/4855cc3edfaf49afb114b91e5661f05c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.077384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41fa0ef56ab44b5bbec496e428082d2)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.078479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf92df087cc4f4695f2ca8c59508a6f, user_id=4855cc3edfaf49afb114b91e5661f05c, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.079419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.082221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5c054-5c55-4042-b6d6-c6b32618ef12 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.092550 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 965/1963] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:17 2022] PUT /identity/v3/projects/edf92df087cc4f4695f2ca8c59508a6f/users/4855cc3edfaf49afb114b91e5661f05c/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:17.104878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.105112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.105383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.138074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] MFA Rules not processed for user `4855cc3edfaf49afb114b91e5661f05c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.139426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.157505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41fa0ef56ab44b5bbec496e428082d2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.165444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41fa0ef56ab44b5bbec496e428082d2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.173012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41fa0ef56ab44b5bbec496e428082d2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.173630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41fa0ef56ab44b5bbec496e428082d2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.174363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41fa0ef56ab44b5bbec496e428082d2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.191159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 999/1964] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:16 2022] DELETE /identity/v3/users/a41fa0ef56ab44b5bbec496e428082d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:17.194884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.196252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.212368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 966/1965] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:17.224271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.225790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.267610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21442736-fbc4-45c0-9180-ee147e4133e7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.273556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.274430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.274744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.275020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] PATH_INFO: `/v3/projects/fc1f105e69264c54b1645c399b7902f0` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.276384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1f105e69264c54b1645c399b7902f0)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.278364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.291042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839b37c-a262-4a11-8327-c14693d86213 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.330531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1f105e69264c54b1645c399b7902f0', 'request_id': 'req-fe91044c-41ce-4fc9-be1d-106f60479f94'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.351721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.352401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.352689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.352969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.355209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1f105e69264c54b1645c399b7902f0', 'request_id': 'req-fe91044c-41ce-4fc9-be1d-106f60479f94'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.355559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.365423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1f105e69264c54b1645c399b7902f0', 'request_id': 'req-fe91044c-41ce-4fc9-be1d-106f60479f94'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.379345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] The token cache is being invalidate because project fc1f105e69264c54b1645c399b7902f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:17.379912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.380413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fe91044c-41ce-4fc9-be1d-106f60479f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.385599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1000/1966] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:17 2022] DELETE /identity/v3/projects/fc1f105e69264c54b1645c399b7902f0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:17.386936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.387221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.387498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.407114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.408729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.434648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.436178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca53af-2c28-4f94-97bb-ce9c89c0bc98 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.447272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 967/1967] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:17.486648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1001/1968] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:17.492544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.492544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.492544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.516071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.517508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.530880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.532120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.543638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 968/1969] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:17.546967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.547556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553794f-08fd-489f-acd4-0d3175d3dca2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.554352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.555486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.555939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.556622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] PATH_INFO: `/v3/projects/7a91c03cc64a4059847caa954af234cd` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.558145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e2df1-9836-4ca0-9011-36d43f93b355 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.558362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a91c03cc64a4059847caa954af234cd)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.564849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.564990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.566383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.567006 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.567694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.569042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:17.569452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.571295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.585591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 969/1970] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:57:17.589991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.601154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2dde9-c180-4530-9497-398b14fa46ca admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.605923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.606614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.606949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.607336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.608577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.609908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.619623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a91c03cc64a4059847caa954af234cd', 'request_id': 'req-03ef6777-9e45-4d27-96d7-df4609d35f92'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.629495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a91c03cc64a4059847caa954af234cd', 'request_id': 'req-03ef6777-9e45-4d27-96d7-df4609d35f92'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.636275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a91c03cc64a4059847caa954af234cd', 'request_id': 'req-03ef6777-9e45-4d27-96d7-df4609d35f92'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.651145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 970/1971] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:17.651302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] The token cache is being invalidate because project 7a91c03cc64a4059847caa954af234cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:17.651302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.651939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-03ef6777-9e45-4d27-96d7-df4609d35f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:17.652437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.653810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1002/1972] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:17 2022] DELETE /identity/v3/projects/7a91c03cc64a4059847caa954af234cd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:17.654707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.658485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522945-8170-4f1d-afb0-419f853363a8 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.659408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522945-8170-4f1d-afb0-419f853363a8 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.660296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522945-8170-4f1d-afb0-419f853363a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.679287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7e522945-8170-4f1d-afb0-419f853363a8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.680701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7e522945-8170-4f1d-afb0-419f853363a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.726665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407485a-1adb-4cfb-93e7-92ac69105caa admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.732462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.733181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.733468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.733745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.734430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.736466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.751667 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1003/1973] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:17.761620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.762050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.762438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.771313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 971/1974] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:17.772464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.783711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef6c2-daee-4714-8eab-4eeabecc38ba admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.786274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.787695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.789839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.790556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.790848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.791152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.791920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.793626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.801511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1004/1975] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:17.802960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.807202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 972/1976] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:17.812488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2eee9-915f-4ac2-9739-bb812748f515 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.818395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.818922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.819604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.819894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.820175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.820911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:17.821228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.823043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.831687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916348-1fc6-4358-b103-3d8c328499b4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.836669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1005/1977] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:17.837377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.838052 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.838539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.838823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.839560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.840956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.841239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.853452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd82e-88cd-412e-9fec-de92356fbd25 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.855062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 973/1978] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:17.859290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.859439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.860253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.860602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.860885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.861622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.864455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.877600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088954e-28ef-4185-be16-b2e8d863c9a1 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:17.882473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:17.883383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.883643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.883902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] PATH_INFO: `/v3/projects/3c4229616c374f838805317cdedc1067/users/6f37473b227e42129b8b15e5d1c8538a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.897379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1006/1979] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:17.901581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4229616c374f838805317cdedc1067, user_id=6f37473b227e42129b8b15e5d1c8538a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:17.901710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:17.904578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90944c8b-49fc-43d9-90d0-8f72d4c48e86 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:17.919551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 974/1980] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:17 2022] PUT /identity/v3/projects/3c4229616c374f838805317cdedc1067/users/6f37473b227e42129b8b15e5d1c8538a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:17.930076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:17.930379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:17.930710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:17.959695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] MFA Rules not processed for user `6f37473b227e42129b8b15e5d1c8538a`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:17.960974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:17.981821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e153-7c53-4dd7-b842-a5076b36e9e3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.028913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 975/1981] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:18.033999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.044448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.045127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.045408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.045680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.046366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.048318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.070503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1007/1982] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:17 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:18.073091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.084271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964945f-5589-41ad-a53f-a39af4f0a930 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.089856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.090630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.090990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.091344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.092154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.093831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.107135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1008/1983] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:18.107264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9db37-26f0-4e62-9073-ac6b9fe3735f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.108229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.108890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.109554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.109834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.110114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.110831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.113262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.119121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3c-ab44-41b0-9ba1-4b31361f5d3d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.125623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.126281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.126608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.127021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.127636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.129854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.142750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 976/1984] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:18 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:18.143264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1009/1985] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:18.144482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.144634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.153922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca6e8-f6a2-4997-8037-7461bd525c93 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.204173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62c99c-d38d-4187-87cd-20b9c31e837d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.208218 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.209005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.209143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.209393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.209663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.209763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] PATH_INFO: `/v3/projects/ef09b07e216740248983d75373a66876/users/9907f31f59134c78891a7e45b998e9ea/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.209946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.210223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.210938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.212851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.224252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef09b07e216740248983d75373a66876, user_id=9907f31f59134c78891a7e45b998e9ea, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.227162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9335739-981b-468d-8f5c-fd945f8a8d50 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.233464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 977/1986] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:18 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:18.238037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.241070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1010/1987] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:18 2022] PUT /identity/v3/projects/ef09b07e216740248983d75373a66876/users/9907f31f59134c78891a7e45b998e9ea/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:18.246022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.246383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.246693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.247790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6907cf-5257-4071-993e-6bf740e2c855 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.263989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:18.265217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:18.303816 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.304486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.304771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.305051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.305779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.307416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.317189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 978/1988] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:18.321268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.322222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1011/1989] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:18.331102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07621d30-2a3f-45e1-9a46-bebf46e2d7df admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.331753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.333099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:18.335730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.336598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.336879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.337159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] PATH_INFO: `/v3/projects/584f505cf491458096cf8eb99eb89c69/users/e014774e7c554dab97815feed40e37b6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.352100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584f505cf491458096cf8eb99eb89c69, user_id=e014774e7c554dab97815feed40e37b6, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.354852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.368384 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 979/1990] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:18 2022] PUT /identity/v3/projects/584f505cf491458096cf8eb99eb89c69/users/e014774e7c554dab97815feed40e37b6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:18.372070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.392423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe114d64-d211-45d0-847f-0f0fa3a4a672 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.432994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776e54-bb2f-4759-b86e-f22265f3dd91 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.437690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.438354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.438672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.438949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.439696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.440380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.441027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.441284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.441384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.441579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.450634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.451553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 980/1991] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:18.452084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d9bf-d11c-4caf-9a47-0ea3dba86a72 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.455383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.462008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1012/1992] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:18.464912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709563-9494-4849-bdc4-ab62e0cfb1c9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.469524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.470398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.470711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.470992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] PATH_INFO: `/v3/projects/584f505cf491458096cf8eb99eb89c69/users/e014774e7c554dab97815feed40e37b6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.473544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=584f505cf491458096cf8eb99eb89c69, user_id=e014774e7c554dab97815feed40e37b6, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.476237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.491181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 981/1993] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:18 2022] PUT /identity/v3/projects/584f505cf491458096cf8eb99eb89c69/users/e014774e7c554dab97815feed40e37b6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:18.504426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.504965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.505481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.539030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] MFA Rules not processed for user `e014774e7c554dab97815feed40e37b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:18.540613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:18.631284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1013/1994] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:18.643083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.645919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:18.705072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297436e-885b-46cb-9a22-1315060d0c2e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.710872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.711531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.711814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.712112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.722589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.724026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7e938-cea9-4f08-b96c-285752424ae3 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.734108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 982/1995] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:18.806332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:18.819716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e01efb-a9c5-4d1a-afcb-876843f9ca2d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:18.823013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:18.824892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:18.824892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:18.824892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:18.884675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:18.886064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:18.896210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1014/1996] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:19.691554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:19.692066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:19.692147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:19.728951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] MFA Rules not processed for user `9907f31f59134c78891a7e45b998e9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:19.730250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:19.832370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 983/1997] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:19.833856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:19.903866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da91d5-d5bb-44fa-9a9d-4bedced0e1c7 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:19.908687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:19.909849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:19.910132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:19.910409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:19.911153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:19.913066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:19.943616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1015/1998] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:19 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:19.944991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:19.955922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0ce47-15bb-4481-8cd5-1beef14a8dee None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:20.013767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:20.014435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.014745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.015015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.015694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:20.017609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:20.040795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 984/1999] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:19 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:20.042914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:20.053253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dcb85-a4ad-47a6-8ab3-adc52993c8c2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:20.058390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:20.059082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.059367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.059681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.060372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:20.061987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:20.076102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1016/2000] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:20.077425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:20.088643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f39f4-a3d9-4689-bd46-9ba95a197aa2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:20.093327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:20.094205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.094512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.094794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] PATH_INFO: `/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2/users/a1eb027a24844054a1d43b5dccaaf618/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.109503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e035d66fd5a24ebe8ce34ca0b6a4d5f2, user_id=a1eb027a24844054a1d43b5dccaaf618, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:20.112220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:20.125438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 985/2001] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:20 2022] PUT /identity/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2/users/a1eb027a24844054a1d43b5dccaaf618/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:20.129425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:20.139243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229a10-0ded-4d11-834b-52c6d95bd745 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:20.193849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:20.194436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.194751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.195057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.195783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:20.197398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2083388-b473-4bc6-9373-4d78090a4d01 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:20.208325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1017/2002] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:20.212699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:20.223531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96eb2-f1c2-48ba-b439-eb89426c5e70 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:20.228175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:20.229049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.229333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.229611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] PATH_INFO: `/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2/users/a1eb027a24844054a1d43b5dccaaf618/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.231623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e035d66fd5a24ebe8ce34ca0b6a4d5f2, user_id=a1eb027a24844054a1d43b5dccaaf618, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:20.234700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:20.244861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 986/2003] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:20 2022] PUT /identity/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2/users/a1eb027a24844054a1d43b5dccaaf618/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:20.966309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:20.966885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:20.966885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:20.999458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] MFA Rules not processed for user `a1eb027a24844054a1d43b5dccaaf618`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:21.000738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:21.115262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1018/2004] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:21.163706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:21.239458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148846-f047-473c-8d35-0034676375c2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:21.244623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:21.245315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:21.245600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:21.246041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:21.304169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:21.305611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:21.315101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 987/2005] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:21.767765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:21.769899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:21.835488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70ebc9-f26c-48f3-ad7e-e60a68ed18e5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:21.840835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:21.841750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:21.842042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:21.842314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] PATH_INFO: `/v3/users/7f3cef4a86dd4b9cb57619148760ba88` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:21.843583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3cef4a86dd4b9cb57619148760ba88)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:21.845527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:21.903229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3cef4a86dd4b9cb57619148760ba88'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:21.910442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3cef4a86dd4b9cb57619148760ba88'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:21.918731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3cef4a86dd4b9cb57619148760ba88'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:21.919488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3cef4a86dd4b9cb57619148760ba88'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:21.920197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8f9d3dd9-b587-4027-82e8-fe06751f3a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3cef4a86dd4b9cb57619148760ba88'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:21.937525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1019/2006] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:21 2022] DELETE /identity/v3/users/7f3cef4a86dd4b9cb57619148760ba88 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:22.114940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.126813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd533-e19c-4dc1-befa-d095335fada3 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.187314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.188347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.188637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.191456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] PATH_INFO: `/v3/projects/25b61967dc5c42ceb097f40a01045bfa` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.191456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b61967dc5c42ceb097f40a01045bfa)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.192660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.246036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b61967dc5c42ceb097f40a01045bfa', 'request_id': 'req-1bcac145-5eea-455c-8767-6f97799b20c7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.252864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b61967dc5c42ceb097f40a01045bfa', 'request_id': 'req-1bcac145-5eea-455c-8767-6f97799b20c7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.260252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b61967dc5c42ceb097f40a01045bfa', 'request_id': 'req-1bcac145-5eea-455c-8767-6f97799b20c7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.272581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] The token cache is being invalidate because project 25b61967dc5c42ceb097f40a01045bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:22.272876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.273541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.275385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 988/2007] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:22 2022] DELETE /identity/v3/projects/25b61967dc5c42ceb097f40a01045bfa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:22.280773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca663d-0eb0-414d-9d9f-166c14bdefda None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.281229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca663d-0eb0-414d-9d9f-166c14bdefda None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.281766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca663d-0eb0-414d-9d9f-166c14bdefda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.309277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.311088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.313708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-92ca663d-0eb0-414d-9d9f-166c14bdefda None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:22.318168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-92ca663d-0eb0-414d-9d9f-166c14bdefda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.378955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac145-5eea-455c-8767-6f97799b20c7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.383047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.383764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.384099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.384579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1020/2008] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:22.384701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.386436 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.392324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.392615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.393585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.414136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:22.415553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.424520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1021/2009] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:22.428909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.438649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f186c-0640-4be7-9eee-07e27f5f7a1b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.443831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.444490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.444777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.445061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.445834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:22.446132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.447773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.459579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.461007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.461235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1022/2010] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:22.466100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.473355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 989/2011] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:22.483763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886eb0-7d11-4953-b386-908b2bdac7c5 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.487329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.490058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.490279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.490937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.491319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.491670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.492441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.494627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.510004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c794df5-fae9-44d3-9be0-3d9f99b6fa4b service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.516342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.527130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.527924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.528638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] PATH_INFO: `/v3/users/6f37473b227e42129b8b15e5d1c8538a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.530963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f37473b227e42129b8b15e5d1c8538a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.533241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.535860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1023/2012] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:22 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:22.540043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.592895 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f37473b227e42129b8b15e5d1c8538a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.602294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f37473b227e42129b8b15e5d1c8538a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.603145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f37473b227e42129b8b15e5d1c8538a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.619500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f37473b227e42129b8b15e5d1c8538a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.620331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bba11867-0d35-46c1-b5e8-5ab52808b8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f37473b227e42129b8b15e5d1c8538a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.626587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1348eb-af34-4590-b1a3-d000b1e4bddf admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.635869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.636531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.636890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.637240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.638073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.638646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 990/2013] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:22 2022] DELETE /identity/v3/users/6f37473b227e42129b8b15e5d1c8538a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:22.640386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.644000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.644413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.644765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.670045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1024/2014] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:22 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:22.670330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:22.670330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.671293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.673397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.687540 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5c326-99c1-487b-835c-e8c9b194b6be admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.740058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 991/2015] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:22.750766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.753129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.785323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.789566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.789861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.790443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.792012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.793689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.808451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1025/2016] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:22.809177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.811681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.837215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b45ec9-e71d-43ce-9520-d324573d99f1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.841021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.841674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.841957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.842233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.853981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.855473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.871437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 992/2017] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:22.872661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:22.874614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.886799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7f17-f0c3-43a0-b551-b3682e036103 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.889845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc565-14d7-4266-a648-807b0698dfdd service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:22.891361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.892333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.892625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.892909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.896307 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:22.899401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:22.901173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:22.901655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:22.902109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] PATH_INFO: `/v3/users/cdfe2a5ca4454d43a75a5d9d58c3fe43` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:22.904325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfe2a5ca4454d43a75a5d9d58c3fe43)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.908303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:22.982479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfe2a5ca4454d43a75a5d9d58c3fe43'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.994383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfe2a5ca4454d43a75a5d9d58c3fe43'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.995417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfe2a5ca4454d43a75a5d9d58c3fe43'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:22.995780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:22.997251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.012348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfe2a5ca4454d43a75a5d9d58c3fe43'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.013108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-4122065c-00a1-40f6-8f82-525841cd4b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfe2a5ca4454d43a75a5d9d58c3fe43'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.014769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1026/2018] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:23.018057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.030498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 993/2019] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:22 2022] DELETE /identity/v3/users/cdfe2a5ca4454d43a75a5d9d58c3fe43 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:23.035714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.036051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.036278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.048276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3785a1-fed3-4f4d-8cde-d819ce09b80e service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.058920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:23.066134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.148913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.149589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.149870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.150147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.151513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.153616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.168422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1027/2020] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:23.169399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.171051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.184791 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb482-bb4f-4eff-8a66-869e6f93de45 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.193407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.197539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 994/2021] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:23.199177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.199659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.200172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] PATH_INFO: `/v3/projects/20eb28f8e08e4214b136dadde33c1223/users/e79c95449c6f4b7491b7373ff546e67b/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.206258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.207759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.229330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20eb28f8e08e4214b136dadde33c1223, user_id=e79c95449c6f4b7491b7373ff546e67b, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.230348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.253483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1028/2022] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:23 2022] PUT /identity/v3/projects/20eb28f8e08e4214b136dadde33c1223/users/e79c95449c6f4b7491b7373ff546e67b/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:23.262701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.264362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.295122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707450-f5f4-45d1-b358-8e5b9166db3d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.345013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.345660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.345941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.346245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.347195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192df1-1f04-4343-930f-b9b591632bc4 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.351985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.352841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.353126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.353405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] PATH_INFO: `/v3/projects/3c4229616c374f838805317cdedc1067` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.354656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4229616c374f838805317cdedc1067)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.355283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.356579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.356702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a54ea6-0f8c-4a46-a32f-63268ff3bd1f service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.366728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 995/2023] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:23.367996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.368329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.368614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.396664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] MFA Rules not processed for user `e79c95449c6f4b7491b7373ff546e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:23.397996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.411392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4229616c374f838805317cdedc1067', 'request_id': 'req-b513c583-efd7-44af-990c-d04941194cf7'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.421060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4229616c374f838805317cdedc1067', 'request_id': 'req-b513c583-efd7-44af-990c-d04941194cf7'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.429508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4229616c374f838805317cdedc1067', 'request_id': 'req-b513c583-efd7-44af-990c-d04941194cf7'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.444555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] The token cache is being invalidate because project 3c4229616c374f838805317cdedc1067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:23.444858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.445769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.447761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1029/2024] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:23 2022] DELETE /identity/v3/projects/3c4229616c374f838805317cdedc1067 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:23.451820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.453160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.472435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 996/2025] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:23.484897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.487888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.534906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513c583-efd7-44af-990c-d04941194cf7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.541054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.541949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.542208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.542513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] PATH_INFO: `/v3/users/e014774e7c554dab97815feed40e37b6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.543806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e014774e7c554dab97815feed40e37b6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.545804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.592391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46497163-3abb-4e40-8570-c229c99ffd61 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.595762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e014774e7c554dab97815feed40e37b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.599102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.599788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.600041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.600317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.603514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e014774e7c554dab97815feed40e37b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.608649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.610686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.612735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e014774e7c554dab97815feed40e37b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.613494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e014774e7c554dab97815feed40e37b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.614120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e014774e7c554dab97815feed40e37b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.621704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 997/2026] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:23.633973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1030/2027] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:23 2022] DELETE /identity/v3/users/e014774e7c554dab97815feed40e37b6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:23.696015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.699668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.717619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cf709-0e65-445d-b24f-8b9b3a7f8b39 service nova] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.825105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.826779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.827290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.827662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] PATH_INFO: `/v3/projects/b5a3bc6f2b1f43b48dc418dfba066489` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.829211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a3bc6f2b1f43b48dc418dfba066489)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.831768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:23.872023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.873995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.892123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b47a13-c115-4e96-9fcc-a23443a85911 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:23.912415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a3bc6f2b1f43b48dc418dfba066489', 'request_id': 'req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.921096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a3bc6f2b1f43b48dc418dfba066489', 'request_id': 'req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.932552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a3bc6f2b1f43b48dc418dfba066489', 'request_id': 'req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.947492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] The token cache is being invalidate because project b5a3bc6f2b1f43b48dc418dfba066489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:23.948057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.948925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:23.950664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 998/2028] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:23 2022] DELETE /identity/v3/projects/b5a3bc6f2b1f43b48dc418dfba066489 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:23.954847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:23.956748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:23.976244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:23.978264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:23.978587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:23.978873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] PATH_INFO: `/v3/users/e79c95449c6f4b7491b7373ff546e67b` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:23.980798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79c95449c6f4b7491b7373ff546e67b)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:23.984166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.040216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79c95449c6f4b7491b7373ff546e67b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.049048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79c95449c6f4b7491b7373ff546e67b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.060032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79c95449c6f4b7491b7373ff546e67b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.060757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79c95449c6f4b7491b7373ff546e67b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.061563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79c95449c6f4b7491b7373ff546e67b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.066322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e3b4-6d8f-4cd9-88ef-4cf3e071021d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.073409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.074377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.074719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.075001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] PATH_INFO: `/v3/users/839632ab7268487a9af6080f7255f704` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.076215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=839632ab7268487a9af6080f7255f704)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.079192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.085934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1031/2029] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:23 2022] DELETE /identity/v3/users/e79c95449c6f4b7491b7373ff546e67b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:24.086943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.088312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.132433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839632ab7268487a9af6080f7255f704'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.140221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839632ab7268487a9af6080f7255f704'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.141046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839632ab7268487a9af6080f7255f704'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.160638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839632ab7268487a9af6080f7255f704'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.160638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0b926c37-5184-43a6-8e1a-2100c87363ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839632ab7268487a9af6080f7255f704'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.162301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce54dc5-cfda-4b05-b265-cfcde6cbbd05 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.168829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.169760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.170070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.170320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] PATH_INFO: `/v3/projects/584f505cf491458096cf8eb99eb89c69` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.171575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584f505cf491458096cf8eb99eb89c69)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.173626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.176404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 999/2030] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:23 2022] DELETE /identity/v3/users/839632ab7268487a9af6080f7255f704 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:24.178743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.190696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.191271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.221762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.223055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.237938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584f505cf491458096cf8eb99eb89c69', 'request_id': 'req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.248571 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584f505cf491458096cf8eb99eb89c69', 'request_id': 'req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.256432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584f505cf491458096cf8eb99eb89c69', 'request_id': 'req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.272433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] The token cache is being invalidate because project 584f505cf491458096cf8eb99eb89c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:24.272725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.273394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2d9fac70-8a18-4bc6-a9f4-e782146c6fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.275512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1032/2031] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:24 2022] DELETE /identity/v3/projects/584f505cf491458096cf8eb99eb89c69 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:24.280748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e122-9826-453b-807c-4ee3b52d6799 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.281031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e122-9826-453b-807c-4ee3b52d6799 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.281305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e122-9826-453b-807c-4ee3b52d6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.303371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1000/2032] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:24.309552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-96d6e122-9826-453b-807c-4ee3b52d6799 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.310945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96d6e122-9826-453b-807c-4ee3b52d6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.315211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.317891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.322970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1033/2033] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:24.333424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.333955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.334584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.364238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.365985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.383512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1034/2034] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:24.384686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.406541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e41c99-739e-4c58-8212-aa14b8f7512d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.412840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.415038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.416541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.416541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.417051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:24.417426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.419679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.437677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1035/2035] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:24.443081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.449934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204664ca-eb3b-4a56-a935-cbbaeb0b7a89 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.454607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cae1c-27cc-4e46-9e50-72c7b5905740 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.456565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.457390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.457731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.458016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.461375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.462375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.462943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.468741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.470095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.473010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.479005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.482716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.497421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1001/2036] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:24.510710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1036/2037] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:24.514549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.528007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87286a42-eeca-4fd5-b58a-54523ce71d98 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.595859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.597759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.625884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.626601 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.628560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.628855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.630065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.635371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.675969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1002/2038] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:24.680061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.696662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cf9eb-beb1-47af-9b7e-400f9641f5c9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.703655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.704437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.704796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.705144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.706727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.710644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.713639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23d88c-0f80-481e-8c17-d57bcec12bd7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.719292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.720335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.720755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.721187 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] PATH_INFO: `/v3/projects/4847e7da7a1e40e786d5edcb43712896` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.722698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4847e7da7a1e40e786d5edcb43712896)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.725744 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1003/2039] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:24.726519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.729923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.741771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93d021-4dba-460d-8544-eed148706a5c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.747020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.747818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.748454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.748718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.749456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.751125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.762190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1004/2040] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:24.766624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.779938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380b7b2-6261-4a59-8303-f1b874a79be4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.787398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4847e7da7a1e40e786d5edcb43712896', 'request_id': 'req-98408bdf-18d0-441d-90b6-d7b94866a810'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.795915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4847e7da7a1e40e786d5edcb43712896', 'request_id': 'req-98408bdf-18d0-441d-90b6-d7b94866a810'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.802024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4847e7da7a1e40e786d5edcb43712896', 'request_id': 'req-98408bdf-18d0-441d-90b6-d7b94866a810'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.816248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] The token cache is being invalidate because project 4847e7da7a1e40e786d5edcb43712896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:24.816438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.817114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-98408bdf-18d0-441d-90b6-d7b94866a810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:24.819031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1037/2041] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:24 2022] DELETE /identity/v3/projects/4847e7da7a1e40e786d5edcb43712896 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:24.823786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba1c0-c7e4-477d-9fa9-525be87a2934 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.824076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba1c0-c7e4-477d-9fa9-525be87a2934 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.824354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba1c0-c7e4-477d-9fa9-525be87a2934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.843697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bd7ba1c0-c7e4-477d-9fa9-525be87a2934 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.845023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bd7ba1c0-c7e4-477d-9fa9-525be87a2934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.848337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.849593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.850027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.850430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] PATH_INFO: `/v3/projects/c546c57dc38a4f26a0eaf0e253f65c49/users/873f7eebb3a44ecbb8ced32872b4f7c2/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.854838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1038/2042] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:24.862736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.863185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.863550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.870378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c546c57dc38a4f26a0eaf0e253f65c49, user_id=873f7eebb3a44ecbb8ced32872b4f7c2, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.873755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cda3b-da7f-4e50-ae52-7d419b6ea1c4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.885251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.886586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.894588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1005/2043] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:24 2022] PUT /identity/v3/projects/c546c57dc38a4f26a0eaf0e253f65c49/users/873f7eebb3a44ecbb8ced32872b4f7c2/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:24.899234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.899529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.899812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.930264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] MFA Rules not processed for user `873f7eebb3a44ecbb8ced32872b4f7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:24.931917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:24.962575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1039/2044] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:24.963912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:24.974857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba50e0f-2524-4a06-8963-166e0747ea37 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:24.982241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:24.982966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:24.983250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:24.983822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:24.984248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:24.984554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:24.986202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:24.999701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1040/2045] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:57:25.003768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.007169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1006/2046] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:25.011141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.012852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.014447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8b6a6-a075-44ee-ae5f-99c73c99c375 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.020598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.021250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.021565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.022006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.022740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.025357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.026571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e882072-054d-45f7-835f-cab6b0a117b2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.031703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.032428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.032774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.033114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.034358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.036403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.059990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1041/2047] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:25.061132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.063118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1007/2048] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:25.068053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.130665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2487f-1e7f-4aaa-a7a8-37199e77ea27 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.142999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764971-08a5-43f3-b7f6-ca3a84baafd5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.148293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.148958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.149236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.149511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.150202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.152139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.175600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1008/2049] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:25.176459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.178084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.191132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945266c-ae74-408f-83a5-a1c5d5c4acba admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.196704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.196872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.197529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.197820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.197937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.198213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.198326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.198643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] PATH_INFO: `/v3/projects/20eb28f8e08e4214b136dadde33c1223` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.199273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.200067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20eb28f8e08e4214b136dadde33c1223)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.201347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.202101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.226421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1042/2050] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:25.226421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.235185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72979133-73a2-436d-bbbb-2cb42444a207 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.240991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.241758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.241988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.242259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.243269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.244639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.256015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1043/2051] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:25.260099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20eb28f8e08e4214b136dadde33c1223', 'request_id': 'req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:25.260572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.267616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20eb28f8e08e4214b136dadde33c1223', 'request_id': 'req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:25.271749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1c0bd-4dbf-4fc8-9efd-1ac0b83acf62 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.277137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20eb28f8e08e4214b136dadde33c1223', 'request_id': 'req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:25.288962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] The token cache is being invalidate because project 20eb28f8e08e4214b136dadde33c1223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:25.289376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:25.290112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:25.291729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1009/2052] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:25 2022] DELETE /identity/v3/projects/20eb28f8e08e4214b136dadde33c1223 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:25.295654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.297042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.329566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.330152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.330487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.330772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.331490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.333094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910aa75-7ee7-4760-a4fb-ff2b8a5b5cad admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.342647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1044/2053] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:25.343868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.344161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.344439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.362949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:25.364143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.370771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebe3fe-a1aa-4506-a42a-cebe11df54b8 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.372179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1045/2054] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:25.380132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.380132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.383938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.384858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.385125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.385406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] PATH_INFO: `/v3/projects/ee6bdc099c04410ea9f7423794b5aebe/users/47b9c89b0b874068a4949e40c82a89c8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.386525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc67d50-475c-4052-b89b-ca204e0a8e17 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.391192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.391845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.392129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.392403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.393157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.394800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381fde2-8fb0-41ee-889d-5bcc98a3c687 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.399796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6bdc099c04410ea9f7423794b5aebe, user_id=47b9c89b0b874068a4949e40c82a89c8, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.402705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.404758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1046/2055] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:25.405983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.406271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.406568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.421248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1010/2056] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:25 2022] PUT /identity/v3/projects/ee6bdc099c04410ea9f7423794b5aebe/users/47b9c89b0b874068a4949e40c82a89c8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:25.422211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.428372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:25.429743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.498706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e42d-d94c-4495-979a-b66412691277 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.502303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1047/2057] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:25.503369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.504939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.506365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.506685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.506969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] PATH_INFO: `/v3/projects/1e0234c1eb544036801aa8e383fa811e/users/1439412dedb741458e836ee9d640fda5/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.514826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7d4b-7f2b-40f9-9e9a-009b009358d0 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.525156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0234c1eb544036801aa8e383fa811e, user_id=1439412dedb741458e836ee9d640fda5, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.529040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.534208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.535018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.535291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.535617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.536459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.538890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.545373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1011/2058] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:25 2022] PUT /identity/v3/projects/1e0234c1eb544036801aa8e383fa811e/users/1439412dedb741458e836ee9d640fda5/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:25.546609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.554699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1048/2059] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:25.556038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.567108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea738ca-9994-4cb6-b73c-1d3e4ee9bb78 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.625900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.626727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.627013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.627343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] PATH_INFO: `/v3/projects/ee6bdc099c04410ea9f7423794b5aebe/users/47b9c89b0b874068a4949e40c82a89c8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.629957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6bdc099c04410ea9f7423794b5aebe, user_id=47b9c89b0b874068a4949e40c82a89c8, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.631291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea8cd4-7490-4c80-9226-fa41199a72b3 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.632660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca841d3-2238-492b-b302-979ff6c6d28a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.636124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.636777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.637056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.637330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.638051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:25.638358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.640055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a415cd-27b0-48ca-ae6b-ce3ce3a607ab admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.643244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1049/2060] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:25 2022] PUT /identity/v3/projects/ee6bdc099c04410ea9f7423794b5aebe/users/47b9c89b0b874068a4949e40c82a89c8/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:25.644696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.644989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.645269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.656875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1012/2061] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:25.658212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.662570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.663372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.695775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] MFA Rules not processed for user `1439412dedb741458e836ee9d640fda5`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:25.695962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] MFA Rules not processed for user `47b9c89b0b874068a4949e40c82a89c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:25.697170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.699493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.780230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1013/2062] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:25.785608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.792627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1050/2063] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:25.796673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.846879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8630d-2763-4341-8b66-836db2f7d18f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.851502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.852159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.852440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.852715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.853402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.855322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.864464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a3725-f414-4c92-aaf9-c9b0894a2325 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.869692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.870241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.870623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.870856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.871532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.873710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:25.884993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1014/2064] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:25.885875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.887648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:25.905778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1051/2065] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:25.905778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:25.952602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c68f-33b0-4bcb-8ba5-14de85febdbf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.968334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802831c1-3fbe-44d4-9bc5-93b07071996b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:25.974707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:25.975468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:25.975763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:25.976129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:25.976852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:25.978925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.002801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1052/2066] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:26.002801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.007520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.008274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.008549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.008821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.009991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5616e-6431-47c4-8a82-158142ca0faf admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.014742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.015381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.015674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.015961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.016637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.019146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.039281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1053/2067] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:25 2022] POST /identity/v3/users => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:26.040507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.050067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b8c9-5981-40ca-a3d3-585a42f5bf0b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.054701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.055334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.055620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.055904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.056612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.058188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.068216 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.069732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.070769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1054/2068] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:26.071793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.080031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1015/2069] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:26.081819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.082619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4dca-0979-4f0f-ac59-384c5cc19615 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.087565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.088180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.088460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.088735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.089463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.091177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.096806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5d487-99da-4a1a-8bce-b72817b664f9 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.102178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.102873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.103158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.103312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1055/2070] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:26.106443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.106443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.106443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.107376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.116780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1016/2071] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:26.119342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f42cea-176e-419f-b9cd-07cb250a5afa admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.121217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.132381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.132381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.132381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.132381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] PATH_INFO: `/v3/projects/b238523c88624abaaf867c4d86da5141/users/9c5f12ca51fb4764bea32b80c14f7e87/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.136336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0b438-6472-41ad-9152-f399e62ca5bd admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.141569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.142679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.142999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.143280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] PATH_INFO: `/v3/projects/7838849f1a1b40d6aaba9b6d62260454/users/9ef258b181144e33873c5354e6e3aa16/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.145271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b238523c88624abaaf867c4d86da5141, user_id=9c5f12ca51fb4764bea32b80c14f7e87, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.148167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.160896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7838849f1a1b40d6aaba9b6d62260454, user_id=9ef258b181144e33873c5354e6e3aa16, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.163731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc21315-ed9a-436f-8e6e-42de063a8416 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.164456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1056/2072] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:26 2022] PUT /identity/v3/projects/b238523c88624abaaf867c4d86da5141/users/9c5f12ca51fb4764bea32b80c14f7e87/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:26.169053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.181448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1017/2073] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:26 2022] PUT /identity/v3/projects/7838849f1a1b40d6aaba9b6d62260454/users/9ef258b181144e33873c5354e6e3aa16/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:26.193098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.193271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.193602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.225627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] MFA Rules not processed for user `9ef258b181144e33873c5354e6e3aa16`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:26.227837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:26.253166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f407-eee1-492e-a950-01441ce7e52e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.300683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1018/2074] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:26.305518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.315305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.316268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.316581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.316974 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.317754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.320030 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.334505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1057/2075] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:26.338497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.351730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a906ec-1910-4b71-9e4f-366490b8678d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.358003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.359149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.359369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.360212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] PATH_INFO: `/v3/projects/b238523c88624abaaf867c4d86da5141/users/9c5f12ca51fb4764bea32b80c14f7e87/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.363186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b238523c88624abaaf867c4d86da5141, user_id=9c5f12ca51fb4764bea32b80c14f7e87, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.366257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c79a2-e98c-4bea-9fb2-613c8f67f219 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.378085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40a6d-e6ef-4b69-84e6-819f6a06fb66 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.383321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1058/2076] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:26 2022] PUT /identity/v3/projects/b238523c88624abaaf867c4d86da5141/users/9c5f12ca51fb4764bea32b80c14f7e87/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:26.395258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.395566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.395857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.423844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] MFA Rules not processed for user `9c5f12ca51fb4764bea32b80c14f7e87`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:26.425962 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:26.488785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.489763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.490360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.490806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.491855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.494814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.514197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1059/2077] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:26.522737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.531958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1019/2078] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:26 2022] POST /identity/v3/projects => generated 399 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:26.531958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.533913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:26.590708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6eb2d-b20a-4621-b260-91820c95f686 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.593739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a78c85-3401-4fcf-b19d-59ae2b6598b5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.597801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.598451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.598758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.599032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.661003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b9c89b0b874068a4949e40c82a89c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee6bdc099c04410ea9f7423794b5aebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.661773 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.662067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.662330 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.663219 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:26.663660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.665334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.677890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1060/2079] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:26.681875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.683481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.685057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.696149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1020/2080] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:26.696952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.712925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed71c2-256c-4939-be89-cce6dde2d941 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.719583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b9c89b0b874068a4949e40c82a89c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee6bdc099c04410ea9f7423794b5aebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.720485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.720987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.721432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.722316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.725253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.770567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1021/2081] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:26 2022] POST /identity/v3/projects => generated 353 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:26.770567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.781326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227f984-d028-41c8-a013-df7b5d86cb63 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.840427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377722-ccb7-42e7-af3c-d89d5698ddd8 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.845318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b9c89b0b874068a4949e40c82a89c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee6bdc099c04410ea9f7423794b5aebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.846030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.846317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.846629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.847398 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:26.847731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.848990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.849311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.850025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.850176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.850620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.851371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.853570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.863653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1022/2082] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:57:26.882426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1061/2083] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:26 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:26.883395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.896079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545383-e8d6-4dce-ae60-b9b95bb3a937 tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.902851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.902851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.902851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.902851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.903696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.905348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.907699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.917711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1023/2084] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:26.921789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.921987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ef34a-8770-4a66-bdac-438cb236f1b6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.926792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b9c89b0b874068a4949e40c82a89c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee6bdc099c04410ea9f7423794b5aebe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.927760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.927916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.928188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] PATH_INFO: `/v3/projects/075a9c23eaaa49c78e4cab794bd12e6e` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.929373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorizing `identity:delete_project(project_id=075a9c23eaaa49c78e4cab794bd12e6e)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.931985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.932156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994cfe-9f07-4dd4-973e-10fa40d4dd73 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:26.937103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:26.938089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:26.938580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:26.938931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] PATH_INFO: `/v3/projects/726c740d76964f1aafa1385017129ea2/users/83c7632408c347a7bab132b84fb85349/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:26.965430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726c740d76964f1aafa1385017129ea2, user_id=83c7632408c347a7bab132b84fb85349, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:26.970776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:26.990221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1024/2085] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:26 2022] PUT /identity/v3/projects/726c740d76964f1aafa1385017129ea2/users/83c7632408c347a7bab132b84fb85349/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:26.994021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:26.996978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075a9c23eaaa49c78e4cab794bd12e6e', 'request_id': 'req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.006340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075a9c23eaaa49c78e4cab794bd12e6e', 'request_id': 'req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.013457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075a9c23eaaa49c78e4cab794bd12e6e', 'request_id': 'req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.031459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] The token cache is being invalidate because project 075a9c23eaaa49c78e4cab794bd12e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:27.031906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.032596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.035110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1062/2086] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:26 2022] DELETE /identity/v3/projects/075a9c23eaaa49c78e4cab794bd12e6e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:27.079391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4d44-ec70-4b86-9185-be846a59c317 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.084706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.085378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.085666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.085980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.086859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.088463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde48a1-1582-45ac-9c28-1124b3d17d4b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.099442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1025/2087] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:27.103718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.105424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.179152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d6999-ea76-4154-aac8-a484c2ae8f4c tempest-VolumeQuotaClassesTest-1198672396 tempest-VolumeQuotaClassesTest-1198672396-project-admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.184400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.185321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.185660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.185898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] PATH_INFO: `/v3/projects/726c740d76964f1aafa1385017129ea2/users/83c7632408c347a7bab132b84fb85349/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.188108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726c740d76964f1aafa1385017129ea2, user_id=83c7632408c347a7bab132b84fb85349, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.191397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.218559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1063/2088] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:27 2022] PUT /identity/v3/projects/726c740d76964f1aafa1385017129ea2/users/83c7632408c347a7bab132b84fb85349/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:27.231207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.231710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.232197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.266984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] MFA Rules not processed for user `83c7632408c347a7bab132b84fb85349`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:27.268878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.296947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.298728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.349970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1026/2089] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:27.354200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.355541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.369860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5054426-e2dc-4377-bd8d-202f4bac4387 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.374975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.375845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.376129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.376412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] PATH_INFO: `/v3/users/1439412dedb741458e836ee9d640fda5` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.378174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1439412dedb741458e836ee9d640fda5)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.380190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.420470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcffa02-baaa-4a6c-8b09-85266ca4eb02 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.425074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.425661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1439412dedb741458e836ee9d640fda5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.426121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.426213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.426482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] PATH_INFO: `/v3/users/873f7eebb3a44ecbb8ced32872b4f7c2` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.427711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873f7eebb3a44ecbb8ced32872b4f7c2)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.429637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.433115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1439412dedb741458e836ee9d640fda5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.440577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1439412dedb741458e836ee9d640fda5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.441340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1439412dedb741458e836ee9d640fda5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.442027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1439412dedb741458e836ee9d640fda5'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.460809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1064/2090] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:27 2022] DELETE /identity/v3/users/1439412dedb741458e836ee9d640fda5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:27.461824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.464589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.482345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873f7eebb3a44ecbb8ced32872b4f7c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.489949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873f7eebb3a44ecbb8ced32872b4f7c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.490673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873f7eebb3a44ecbb8ced32872b4f7c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.507878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873f7eebb3a44ecbb8ced32872b4f7c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.508695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0598f216-9e69-42ce-87b4-330c75aa4712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873f7eebb3a44ecbb8ced32872b4f7c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.526124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1027/2091] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:27 2022] DELETE /identity/v3/users/873f7eebb3a44ecbb8ced32872b4f7c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:27.530341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.530673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.530784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d66e0-e116-435f-8117-c024e71f6398 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.530962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.548076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:27.549851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.580786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.581438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.581723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.582003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.583975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.609500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1028/2092] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:27.610284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.612080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.623912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4129-9664-400c-aaf0-913c0f835a93 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.629323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.630170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.630446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.630747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] PATH_INFO: `/v3/users/b281ae272c5542eaa3ae7620bf68a041` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.632012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b281ae272c5542eaa3ae7620bf68a041)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.633904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.651049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.652525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd73b-1501-4aca-a601-e27cd38bb086 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.662590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1065/2093] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:27.664018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.664334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.664676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.683534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b281ae272c5542eaa3ae7620bf68a041'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.684986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:27.686228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.693439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b281ae272c5542eaa3ae7620bf68a041'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.697399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b281ae272c5542eaa3ae7620bf68a041'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.698321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1066/2094] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:27.699047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.700341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.714534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b281ae272c5542eaa3ae7620bf68a041'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.715290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b281ae272c5542eaa3ae7620bf68a041'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:27.735696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1029/2095] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:27 2022] DELETE /identity/v3/users/b281ae272c5542eaa3ae7620bf68a041 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:27.737051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.738413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.772281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165db82-d00e-4b6a-8776-02839a0388a9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.802079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338415d-6cc8-4441-8a72-f2d98c23951e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.806180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.806976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.807353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.807733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.809778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.830913 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.831762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.832027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.832374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.839892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.879248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.880825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3b06-26d8-470e-b9c9-e7e6f24819e0 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.892503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1030/2096] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:27.894013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.894370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.894739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.915154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:27.916965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.917253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.919017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.927205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1031/2097] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:27.927881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.929232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:27.936554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1067/2098] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:27.938905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:27.945345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe1f3e-7b5b-42d1-996f-9528a8453d09 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.949160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec47da1-1c0e-4c8b-93fe-9c10d3f46db2 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:27.951245 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.952329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.952706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.953080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] PATH_INFO: `/v3/users/9ef258b181144e33873c5354e6e3aa16` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.954598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef258b181144e33873c5354e6e3aa16)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.956870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.957543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:27.958261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:27.958683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:27.958883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:27.980003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:27.981845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029a2d4-2d09-4e23-9fc8-2ca1fd3b3918 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:27.994010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1068/2099] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:28.008862 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef258b181144e33873c5354e6e3aa16'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.016517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef258b181144e33873c5354e6e3aa16'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.017219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef258b181144e33873c5354e6e3aa16'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.028937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef258b181144e33873c5354e6e3aa16'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.029641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef258b181144e33873c5354e6e3aa16'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.044102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1032/2100] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:27 2022] DELETE /identity/v3/users/9ef258b181144e33873c5354e6e3aa16 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:28.049634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.050005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.050337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.068238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:28.069601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.132398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1069/2101] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:28.142660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.144168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.217632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb814907-0c9d-4e0b-81d6-ffe2c1313a5e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.222347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.223883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.224169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.224539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.236704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.238828 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.249762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1033/2102] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:28.381922 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.383885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.409841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011556ae-d627-48c9-9cbe-ba32f6cf427c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.421891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.426833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.427408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.427587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] PATH_INFO: `/v3/projects/c546c57dc38a4f26a0eaf0e253f65c49` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.430441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c546c57dc38a4f26a0eaf0e253f65c49)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.433497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.505799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.519266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.551086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5d4f2-b011-42cd-8255-9ee00e4017d4 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.556396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c546c57dc38a4f26a0eaf0e253f65c49', 'request_id': 'req-46f4fec4-f709-4178-9ff9-059098dc9d5d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.570805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c546c57dc38a4f26a0eaf0e253f65c49', 'request_id': 'req-46f4fec4-f709-4178-9ff9-059098dc9d5d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.586887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c546c57dc38a4f26a0eaf0e253f65c49', 'request_id': 'req-46f4fec4-f709-4178-9ff9-059098dc9d5d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.609795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] The token cache is being invalidate because project c546c57dc38a4f26a0eaf0e253f65c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:28.610344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.611190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.613996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1070/2103] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/projects/c546c57dc38a4f26a0eaf0e253f65c49 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:28.615369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.616957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.636713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.638512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.638868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.639212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] PATH_INFO: `/v3/projects/1e0234c1eb544036801aa8e383fa811e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.641262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0234c1eb544036801aa8e383fa811e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.643874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.699996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4fec4-f709-4178-9ff9-059098dc9d5d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.708991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0234c1eb544036801aa8e383fa811e', 'request_id': 'req-62e211be-361f-4d3f-ba88-2994a14a65bb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.715931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0234c1eb544036801aa8e383fa811e', 'request_id': 'req-62e211be-361f-4d3f-ba88-2994a14a65bb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.724649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0234c1eb544036801aa8e383fa811e', 'request_id': 'req-62e211be-361f-4d3f-ba88-2994a14a65bb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.739965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] The token cache is being invalidate because project 1e0234c1eb544036801aa8e383fa811e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:28.740394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.749390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.751399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1034/2104] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/projects/1e0234c1eb544036801aa8e383fa811e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:28.752253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.753891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.770395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.771310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.771590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.771905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] PATH_INFO: `/v3/projects/7aeb98877d59446aa1f1d684fde50349` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.773226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aeb98877d59446aa1f1d684fde50349)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.775251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.823649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e211be-361f-4d3f-ba88-2994a14a65bb admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.826019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aeb98877d59446aa1f1d684fde50349', 'request_id': 'req-09a4ab88-4292-4a74-a332-55eca1fe5988'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.832602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aeb98877d59446aa1f1d684fde50349', 'request_id': 'req-09a4ab88-4292-4a74-a332-55eca1fe5988'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.842520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aeb98877d59446aa1f1d684fde50349', 'request_id': 'req-09a4ab88-4292-4a74-a332-55eca1fe5988'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.854960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] The token cache is being invalidate because project 7aeb98877d59446aa1f1d684fde50349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:28.855365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.856088 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.857784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1071/2105] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/projects/7aeb98877d59446aa1f1d684fde50349 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:28.858589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.859863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:28.893284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.894144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.894435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.894733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] PATH_INFO: `/v3/users/47b9c89b0b874068a4949e40c82a89c8` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.895930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b9c89b0b874068a4949e40c82a89c8)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.897831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.924135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4ab88-4292-4a74-a332-55eca1fe5988 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:28.930015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:28.931194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:28.931611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:28.931897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] PATH_INFO: `/v3/projects/7838849f1a1b40d6aaba9b6d62260454` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:28.933211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7838849f1a1b40d6aaba9b6d62260454)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:28.935602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:28.951450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b9c89b0b874068a4949e40c82a89c8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.960198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b9c89b0b874068a4949e40c82a89c8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.961346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b9c89b0b874068a4949e40c82a89c8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.974835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b9c89b0b874068a4949e40c82a89c8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.975609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b9c89b0b874068a4949e40c82a89c8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.991541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7838849f1a1b40d6aaba9b6d62260454', 'request_id': 'req-34553332-472b-4692-a0df-bb4942e3d7b9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:28.993793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1035/2106] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/users/47b9c89b0b874068a4949e40c82a89c8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:28.994608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:28.996124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.007067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7838849f1a1b40d6aaba9b6d62260454', 'request_id': 'req-34553332-472b-4692-a0df-bb4942e3d7b9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.013291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7838849f1a1b40d6aaba9b6d62260454', 'request_id': 'req-34553332-472b-4692-a0df-bb4942e3d7b9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.031620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] The token cache is being invalidate because project 7838849f1a1b40d6aaba9b6d62260454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:29.031973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.032736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.034998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1072/2107] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/projects/7838849f1a1b40d6aaba9b6d62260454 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.038035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.039730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.075773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d8029-0112-4c17-95c5-6e5a90a6bc2e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.081910 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.088280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.088571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.088857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] PATH_INFO: `/v3/users/9c5f12ca51fb4764bea32b80c14f7e87` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.090442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5f12ca51fb4764bea32b80c14f7e87)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.092395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.117046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34553332-472b-4692-a0df-bb4942e3d7b9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.122884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.124425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.124858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.125017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] PATH_INFO: `/v3/users/4855cc3edfaf49afb114b91e5661f05c` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.126382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4855cc3edfaf49afb114b91e5661f05c)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.129343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.172878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5f12ca51fb4764bea32b80c14f7e87'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.181383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5f12ca51fb4764bea32b80c14f7e87'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.182359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5f12ca51fb4764bea32b80c14f7e87'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.184279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4855cc3edfaf49afb114b91e5661f05c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.192170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4855cc3edfaf49afb114b91e5661f05c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.201017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4855cc3edfaf49afb114b91e5661f05c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.201807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4855cc3edfaf49afb114b91e5661f05c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.202293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4855cc3edfaf49afb114b91e5661f05c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.209812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5f12ca51fb4764bea32b80c14f7e87'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.210600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5f12ca51fb4764bea32b80c14f7e87'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.223273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1073/2108] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/users/4855cc3edfaf49afb114b91e5661f05c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.223273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.223273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.230286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1036/2109] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:28 2022] DELETE /identity/v3/users/9c5f12ca51fb4764bea32b80c14f7e87 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.301317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174fb7-00c9-4082-a172-7fb104af2b88 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.369474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.370553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.370848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.371225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] PATH_INFO: `/v3/users/83c7632408c347a7bab132b84fb85349` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.372693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c7632408c347a7bab132b84fb85349)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.375147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.399626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.401788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.429284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad7a8-6b0b-4205-a1c8-5bd339ff6534 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.438430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.440422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.440977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.441260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] PATH_INFO: `/v3/projects/ee6bdc099c04410ea9f7423794b5aebe` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.441632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c7632408c347a7bab132b84fb85349'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.443446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6bdc099c04410ea9f7423794b5aebe)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.445916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.463263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c7632408c347a7bab132b84fb85349'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.480110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c7632408c347a7bab132b84fb85349'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.481880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c7632408c347a7bab132b84fb85349'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.483034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8cc8da5e-a404-4ffa-ac70-bdae5b821ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c7632408c347a7bab132b84fb85349'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.512971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1074/2110] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/users/83c7632408c347a7bab132b84fb85349 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.515969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6bdc099c04410ea9f7423794b5aebe', 'request_id': 'req-5cb250d1-09e6-42a8-9af1-d377d20c0123'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.523187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6bdc099c04410ea9f7423794b5aebe', 'request_id': 'req-5cb250d1-09e6-42a8-9af1-d377d20c0123'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.535607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6bdc099c04410ea9f7423794b5aebe', 'request_id': 'req-5cb250d1-09e6-42a8-9af1-d377d20c0123'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.554533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] The token cache is being invalidate because project ee6bdc099c04410ea9f7423794b5aebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:29.555166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.556116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.558633 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1037/2111] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/projects/ee6bdc099c04410ea9f7423794b5aebe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:29.563970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.564301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.566354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.566936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.569510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.589004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:29.590203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.667123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb250d1-09e6-42a8-9af1-d377d20c0123 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.672264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.673389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.673717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.674072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] PATH_INFO: `/v3/projects/b238523c88624abaaf867c4d86da5141` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.681197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b238523c88624abaaf867c4d86da5141)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.681355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1075/2112] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:29.681355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.681522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.684293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.702981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b25d1-75d4-46ee-994d-64252f5dc1da None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.709580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.710707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.711167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.711587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] PATH_INFO: `/v3/projects/edf92df087cc4f4695f2ca8c59508a6f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.712953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf92df087cc4f4695f2ca8c59508a6f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.721543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.771702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b238523c88624abaaf867c4d86da5141', 'request_id': 'req-6816fbe2-b648-4c19-af61-dae7b3db5172'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.778670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b238523c88624abaaf867c4d86da5141', 'request_id': 'req-6816fbe2-b648-4c19-af61-dae7b3db5172'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.789740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b238523c88624abaaf867c4d86da5141', 'request_id': 'req-6816fbe2-b648-4c19-af61-dae7b3db5172'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.805472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf92df087cc4f4695f2ca8c59508a6f', 'request_id': 'req-5fdaacca-d341-4d8e-a733-4eef3dff7480'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.807342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] The token cache is being invalidate because project b238523c88624abaaf867c4d86da5141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:29.807759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.808487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6816fbe2-b648-4c19-af61-dae7b3db5172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.813659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1038/2113] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/projects/b238523c88624abaaf867c4d86da5141 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.813659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649fea-a4af-42ba-8a24-f6fe4748b65a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.813659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649fea-a4af-42ba-8a24-f6fe4748b65a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.813659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649fea-a4af-42ba-8a24-f6fe4748b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.817977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf92df087cc4f4695f2ca8c59508a6f', 'request_id': 'req-5fdaacca-d341-4d8e-a733-4eef3dff7480'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.824642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf92df087cc4f4695f2ca8c59508a6f', 'request_id': 'req-5fdaacca-d341-4d8e-a733-4eef3dff7480'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.836606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9e649fea-a4af-42ba-8a24-f6fe4748b65a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:29.838043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9e649fea-a4af-42ba-8a24-f6fe4748b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.842669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] The token cache is being invalidate because project edf92df087cc4f4695f2ca8c59508a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:29.843095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.843843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5fdaacca-d341-4d8e-a733-4eef3dff7480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:29.845707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1076/2114] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/projects/edf92df087cc4f4695f2ca8c59508a6f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:29.850207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.850207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.850207 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.870513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:29.872037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.913807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1039/2115] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:29.915958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.916228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.916545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.940417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:29.941629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.950503 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1040/2116] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:29.957835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.964381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1077/2117] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:29.964381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:29.964381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:29.965171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687905b-69ff-4f76-901c-e7a1e21f69b6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.966114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.966810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.967326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.967685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.968331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:29.968647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.970293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd33f23-3409-49e4-bf06-b5c0969f035f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.974907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bbbad-acdb-4bf9-b892-5b5f92e35986 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:29.980401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:29.981514 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.981963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.982320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] PATH_INFO: `/v3/projects/726c740d76964f1aafa1385017129ea2` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:29.984588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726c740d76964f1aafa1385017129ea2)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:29.989983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1041/2118] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:29.990150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:29.990248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d349f8-7cf4-44cc-b8ee-db2d4ab750aa None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:29.990248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d349f8-7cf4-44cc-b8ee-db2d4ab750aa None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:29.990248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d349f8-7cf4-44cc-b8ee-db2d4ab750aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.008654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a9d349f8-7cf4-44cc-b8ee-db2d4ab750aa None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.010018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a9d349f8-7cf4-44cc-b8ee-db2d4ab750aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.027116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1042/2119] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:30.027116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.027116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.027116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.044053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.045272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.049981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726c740d76964f1aafa1385017129ea2', 'request_id': 'req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:30.057395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726c740d76964f1aafa1385017129ea2', 'request_id': 'req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:30.064768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726c740d76964f1aafa1385017129ea2', 'request_id': 'req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:30.084593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] The token cache is being invalidate because project 726c740d76964f1aafa1385017129ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:30.084880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:30.085579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:30.087632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1078/2120] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:29 2022] DELETE /identity/v3/projects/726c740d76964f1aafa1385017129ea2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:30.088477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.090214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.117145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1043/2121] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:30.118019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.120599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.133431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad237d0-8095-46c8-8c93-3267c5f0a686 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.138254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.139033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.139319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.139638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.140426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:30.140733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.142348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243b14a-4ed0-4533-87b4-8c92c34253ef admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.154044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1044/2122] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:30.157214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.157691 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.158104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.161612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86e7e5-48dd-4332-bf71-5b7fc44e72d6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.166396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.167135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.167419 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.167694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.168406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.170402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.177873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.179121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.188235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1045/2123] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:30.195176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.201991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1079/2124] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.201991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.207782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa376a6-3d5d-472c-b21b-d2b60c442fe3 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.264286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075f3d-f9ea-4362-804f-553e6b30c110 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.269644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.270301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.270440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.270630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.270881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.271226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.271565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.271681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.271944 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.272734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:30.273105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.273618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.275062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92aa0-3bb7-44a6-979f-3debe6512409 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.287965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1046/2125] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:30.289351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.289642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.289948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.312158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.313401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.315567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1080/2126] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.316199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.383685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fa71c-009d-4506-9e41-76b8cafb84df admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.387580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1047/2127] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:30.388683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.389383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.389674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.389950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.390764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.391340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.392881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.400607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907d9d1-1321-440a-a34a-ed8e048b04f0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.405307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.405950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.406232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.406607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.407235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.409684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.416038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1081/2128] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.416038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.423257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9bf4-8e12-449d-86ba-8d3f5883492d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.428838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.429599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.429872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.430147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.430855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.432755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.435596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1048/2129] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.436258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.454952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1082/2130] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/users => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.454952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.462383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce55d-8a34-45ca-a44c-b8aaa3a2b7c5 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.499848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c31c2d-16b3-4a63-bae2-ea3072e08c99 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.504621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.505287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.505574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.505914 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.506656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:30.506975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.508575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.516975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.517583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.518631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.518850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.519547 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.524078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1049/2131] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:30.524592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.524677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.532821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e60bfa-0b5c-424f-937d-c6346a7668be admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.536056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1083/2132] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.536056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.540081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.540864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.541156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.541437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.542130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.544118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.545833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b04ef-ab3f-401f-b19d-ca896c107737 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.550976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.551620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.551901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.552184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.552898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.554499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.565887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1050/2133] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.566792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.566914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1084/2134] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.570750 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.576616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ca1-b26f-4845-8041-b7df752b86d3 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.580596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9e667-92e5-4e0d-b5af-4d2a08cbce0f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.583998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.584645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.584919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.585191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.585917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.587653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.587860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.588315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.588598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.588869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.589600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.593092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.603118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1085/2135] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.607149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.615312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1051/2136] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.617222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9ab6-7db8-4cd2-b1d4-b903e903c477 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.617407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.671657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.672320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.672606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.672887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.673612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.675813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.679365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d70ba-6589-45fc-b7a4-7427544c82eb admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.684075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.684754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.685085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.685464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1086/2137] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.685573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.686076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.686215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.687906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.695736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30713b-5d9c-433a-b62b-bd558e9005fd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.699980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1052/2138] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.699980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.702057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.702958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.703239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.703511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] PATH_INFO: `/v3/projects/1b0e1fbc10194ae8ad3f54f19e735430/users/349f5b26cc53453ab5a86461893f03fa/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.710425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8d0e-37da-4517-b171-d4a66af7a9a1 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.715138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.715800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.716082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.716357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.717042 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.718617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0e1fbc10194ae8ad3f54f19e735430, user_id=349f5b26cc53453ab5a86461893f03fa, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.718990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.721325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.734816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1087/2139] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:30 2022] PUT /identity/v3/projects/1b0e1fbc10194ae8ad3f54f19e735430/users/349f5b26cc53453ab5a86461893f03fa/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:30.744107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.744219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1053/2140] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:30.744219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.753068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414cf63-7190-42fb-9341-2fb8e4ac213e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.795157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d04ac-418e-4b24-b4d8-a931eb5049a1 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.800249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.800911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.801194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.801475 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.802192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.803839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072c6ab-fe73-4ed6-a41e-5c00d9697512 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.807909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.808799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.809080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.809356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] PATH_INFO: `/v3/projects/c6577ac2d97d4d6080d4dcde1d00a0dc/users/1ca8030d98de490580f9df7136a18bdb/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.813457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1088/2141] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.815325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.815617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.815898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.824392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6577ac2d97d4d6080d4dcde1d00a0dc, user_id=1ca8030d98de490580f9df7136a18bdb, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.827116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.841299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1054/2142] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:30 2022] PUT /identity/v3/projects/c6577ac2d97d4d6080d4dcde1d00a0dc/users/1ca8030d98de490580f9df7136a18bdb/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:30.851095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] MFA Rules not processed for user `349f5b26cc53453ab5a86461893f03fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.851207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.851295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.906595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715fe18-983c-42ea-b24a-343fb8e90eca admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.907692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1089/2143] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:30.909166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:30.913020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.913701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.913985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.914267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.915038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.917628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0376fe-3a85-4fea-b38c-fb1f87817c3f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.922961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236da462-6632-4a77-8c2f-ee7c5b27fcbc None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:30.930073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:30.930073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.930073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.930374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] PATH_INFO: `/v3/projects/78ca9238f82b48b18f978a3759851409/users/15fb7ac81f2c4b7fbe6672e7499e68d6/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.936600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1055/2144] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:30.936600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:30.936600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:30.936600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:30.949098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ca9238f82b48b18f978a3759851409, user_id=15fb7ac81f2c4b7fbe6672e7499e68d6, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:30.952149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:30.960528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] MFA Rules not processed for user `1ca8030d98de490580f9df7136a18bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:30.961741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:30.965210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1090/2145] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:30 2022] PUT /identity/v3/projects/78ca9238f82b48b18f978a3759851409/users/15fb7ac81f2c4b7fbe6672e7499e68d6/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:30.966017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.026388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1056/2146] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:31.027523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.036562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedf1e8-f292-4a44-8303-819ffa30b970 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.038575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035afcf-8e5f-443b-a8b0-aac705120f9b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.041427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.042079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.042363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.042670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.043140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.043358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.043796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.044082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.044365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.045130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.046761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.046874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd4e21-6475-4719-b317-591431517581 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.057091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1057/2147] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.058322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.058636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.058913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.073781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1091/2148] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:30 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.074973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.076719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:31.087807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] MFA Rules not processed for user `15fb7ac81f2c4b7fbe6672e7499e68d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:31.088699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:31.145787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bdae-9c45-473a-85dc-e6ec884d9305 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.150061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.150858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.151195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.151482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.164127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1058/2149] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:31.164953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.214733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.216073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.226622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1092/2150] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:31.227435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.230729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3ccbc-0e91-4f56-975d-ffd53a01e6da None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.235652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.237220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.237602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.237985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] PATH_INFO: `/v3/projects/b9f6bea7c7054c878debb3a78fe41891/users/3323ac6234194d6699ef3b592c775e66/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.240239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1b0e-ae6a-4458-8816-bb23b994bcf4 service glance] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.251852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.252909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.253298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.253657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.254362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.256332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.264315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f6bea7c7054c878debb3a78fe41891, user_id=3323ac6234194d6699ef3b592c775e66, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.268959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.280632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1093/2151] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/users => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.281605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.286036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1059/2152] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/b9f6bea7c7054c878debb3a78fe41891/users/3323ac6234194d6699ef3b592c775e66/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:31.287272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.298256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bc9d8-a1eb-4f82-9c3a-aaceb97ed43b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.382204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.383127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.384316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.384969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.385908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.395871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15adbe0-a7ea-4ec7-a2eb-ec27179b9b6b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.407270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93edc-3bcd-4b83-b1fa-ed97245b0069 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.415030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.416090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.416474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.416875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.418811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.421379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.432543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1094/2153] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.434215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.434676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.435122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.437714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1060/2154] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.439017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.449892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aff549-89f3-4a89-bcc2-99440b0a0fd7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.475759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] MFA Rules not processed for user `3323ac6234194d6699ef3b592c775e66`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:31.477875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:31.529477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.530178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.530497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.530771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.531546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.536779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.562520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1061/2155] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.563553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.581717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c78f59-5593-4373-ad6a-e2e516165695 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.586604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1095/2156] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:31.590804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.592459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.593364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.593364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] PATH_INFO: `/v3/projects/8154dc595da74b7292f0f79817efabdd/users/409eefa029034b31b68bba3e8745b03d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.595542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.607562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bca892-ea5a-4aca-9ba0-1d1ce151a59d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.613285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.613848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8154dc595da74b7292f0f79817efabdd, user_id=409eefa029034b31b68bba3e8745b03d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.614010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.614234 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.614628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.615271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.616875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.617131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.627737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1096/2157] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.629191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.633229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1062/2158] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/8154dc595da74b7292f0f79817efabdd/users/409eefa029034b31b68bba3e8745b03d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:31.634183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.640465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29add-6341-4e9d-84b4-622a6f4c2519 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.701265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.701698 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150db65-09bd-480b-ba99-fe827860aa79 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.702064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.702416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.702824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.703730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.705622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.707433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.708526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.708971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.709244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] PATH_INFO: `/v3/projects/5d406fe616114fc986f4b76727ae3ed4/users/ead93838470243eeae0e4b2ac61be3bf/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.730378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d406fe616114fc986f4b76727ae3ed4, user_id=ead93838470243eeae0e4b2ac61be3bf, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.734402 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.735771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1097/2159] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.741318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.751599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1063/2160] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/5d406fe616114fc986f4b76727ae3ed4/users/ead93838470243eeae0e4b2ac61be3bf/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:31.752695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.806883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65af0-31c3-4137-b78f-cfb03c8e5354 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.824171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db464-5941-4d32-afbf-9d4f6287ce13 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.829246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.829917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.830254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.830617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.831314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.833358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.857531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1064/2161] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:31 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:31.857531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.867770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1cb15-e961-40b5-b8ee-6eb7cc7076af admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.870619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.871278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.871557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.871834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.872371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.872580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.873275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.873566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.873842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.874442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.874599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.876180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.884205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1098/2162] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.884953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.888957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1065/2163] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.888957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.895596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804286-f154-4e9d-8d6a-86b5de39bb3f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.898888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52659f6f-e54e-4707-9f02-a54f75fffa13 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.899881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.900530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.900811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.901080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.901820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.903440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.903720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.904560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.904845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.905127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] PATH_INFO: `/v3/projects/8154dc595da74b7292f0f79817efabdd/users/409eefa029034b31b68bba3e8745b03d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.907152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8154dc595da74b7292f0f79817efabdd, user_id=409eefa029034b31b68bba3e8745b03d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.910333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:31.914411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1099/2164] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:31.915104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.922168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1066/2165] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/8154dc595da74b7292f0f79817efabdd/users/409eefa029034b31b68bba3e8745b03d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:31.925159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:31.933068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4cb2-7460-48c3-9112-5597940b69d4 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.983319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043514f-abe6-4ca9-b1ac-9c4e40431d3b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:31.988592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.988857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:31.989749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.990037 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.990131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:31.990320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] PATH_INFO: `/v3/projects/5d406fe616114fc986f4b76727ae3ed4/users/ead93838470243eeae0e4b2ac61be3bf/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.990472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:31.990720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] PATH_INFO: `/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df/users/981cea07cb31407f96c8fe19b9754fee/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:31.992370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d406fe616114fc986f4b76727ae3ed4, user_id=ead93838470243eeae0e4b2ac61be3bf, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:31.995157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4a8b-5873-48d2-b50f-b3c8144c5450 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.006485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b4e49b76ca468c8c70fc0e0b5157df, user_id=981cea07cb31407f96c8fe19b9754fee, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.007430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1100/2166] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/5d406fe616114fc986f4b76727ae3ed4/users/ead93838470243eeae0e4b2ac61be3bf/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:32.008480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de521dcf-756f-46cc-8076-98413409442f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.008769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de521dcf-756f-46cc-8076-98413409442f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.009181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de521dcf-756f-46cc-8076-98413409442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.009504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190667c-b31d-4b68-a166-2f494ac5e9ac admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.024737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1067/2167] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:31 2022] PUT /identity/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df/users/981cea07cb31407f96c8fe19b9754fee/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:32.026027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.026314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.026779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.039460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-de521dcf-756f-46cc-8076-98413409442f None None] MFA Rules not processed for user `409eefa029034b31b68bba3e8745b03d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:32.040723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-de521dcf-756f-46cc-8076-98413409442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:32.054697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] MFA Rules not processed for user `ead93838470243eeae0e4b2ac61be3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:32.055902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:32.113792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1101/2168] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:32.113792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de521dcf-756f-46cc-8076-98413409442f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.128247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1068/2169] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:32.129098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.130410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:32.180084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de521dcf-756f-46cc-8076-98413409442f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.184829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.185529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.185815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.186094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.187009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.188471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.190794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7177e-f2db-4a65-b586-edd328e894e4 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.194226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.194904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.195183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.195472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.198926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1102/2170] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:32.202796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.204570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:32.205615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.207109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.217056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ee5c0-ca24-48c8-ba16-3841c4f96c4c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.217309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1069/2171] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:32.218096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.221053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.221697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.221984 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.222262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.229843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3a836-0dc4-4d0f-b4a9-7ebeab551f60 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.235439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.236901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.237229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.237453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] PATH_INFO: `/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df/users/981cea07cb31407f96c8fe19b9754fee/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.239573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b4e49b76ca468c8c70fc0e0b5157df, user_id=981cea07cb31407f96c8fe19b9754fee, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.242428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa849-ce6e-497f-8697-3611abdade9e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.263002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1070/2172] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:32 2022] PUT /identity/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df/users/981cea07cb31407f96c8fe19b9754fee/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:32.278995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.279358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.279710 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.306223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.307708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.307852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] MFA Rules not processed for user `981cea07cb31407f96c8fe19b9754fee`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:32.309017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:32.317286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1103/2173] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:32.318225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.326701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923c9d0-782d-44b3-bf6c-3b7b79e18545 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.394950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1071/2174] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:32.395859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.396642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.397031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.397565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.460539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.461987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.473931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1104/2175] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:32.567891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:32.580479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09d568-4b98-4820-a189-b8ce4835215f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:32.585191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:32.586211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:32.586764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:32.587103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:32.598594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:32.600110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bf867-e24c-4aca-aa6b-d864c4ce3203 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:32.612905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1072/2176] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:32.967210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:33.045461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5d13-b9bc-400e-ad39-cd63dffe2294 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:33.050619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:33.051485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:33.051772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:33.052053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] PATH_INFO: `/v3/users/3323ac6234194d6699ef3b592c775e66` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:33.053249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3323ac6234194d6699ef3b592c775e66)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:33.055237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:33.101424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3323ac6234194d6699ef3b592c775e66'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.108174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3323ac6234194d6699ef3b592c775e66'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.115796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3323ac6234194d6699ef3b592c775e66'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.116423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3323ac6234194d6699ef3b592c775e66'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.117120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3323ac6234194d6699ef3b592c775e66'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.135474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1105/2177] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:32 2022] DELETE /identity/v3/users/3323ac6234194d6699ef3b592c775e66 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:33.139967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:33.140261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:33.140541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:33.159489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:33.160715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:33.217546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1073/2178] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:33.227637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:33.229033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:33.287252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792db14-cd83-4a4d-884e-d88ae38a4ee7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:33.290937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:33.291579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:33.291916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:33.292199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:33.301562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:33.303071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:33.312888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1106/2179] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:33.576855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:33.578320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:33.591038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686c74c-5b9d-4f41-9ba2-0614ef56c4d8 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:33.596690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:33.597653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:33.597941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:33.598296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] PATH_INFO: `/v3/projects/b9f6bea7c7054c878debb3a78fe41891` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:33.599676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f6bea7c7054c878debb3a78fe41891)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:33.601855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:33.649753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f6bea7c7054c878debb3a78fe41891', 'request_id': 'req-9c823372-66d9-4cfc-a4db-ff847d97a601'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.657158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f6bea7c7054c878debb3a78fe41891', 'request_id': 'req-9c823372-66d9-4cfc-a4db-ff847d97a601'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.666610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f6bea7c7054c878debb3a78fe41891', 'request_id': 'req-9c823372-66d9-4cfc-a4db-ff847d97a601'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.676517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] The token cache is being invalidate because project b9f6bea7c7054c878debb3a78fe41891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:33.676800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.677410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.678980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1074/2180] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:33 2022] DELETE /identity/v3/projects/b9f6bea7c7054c878debb3a78fe41891 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:33.682950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:33.692269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8b82-242b-4721-84b9-917f62f51592 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:33.752360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:33.753277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:33.753562 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:33.753841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] PATH_INFO: `/v3/users/981cea07cb31407f96c8fe19b9754fee` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:33.755143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981cea07cb31407f96c8fe19b9754fee)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:33.757092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:33.805092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981cea07cb31407f96c8fe19b9754fee'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.811979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981cea07cb31407f96c8fe19b9754fee'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.819390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981cea07cb31407f96c8fe19b9754fee'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.819944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981cea07cb31407f96c8fe19b9754fee'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.820607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3bf519f3-836f-4a71-ab19-baec374ef137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981cea07cb31407f96c8fe19b9754fee'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:33.838977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1107/2181] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:33 2022] DELETE /identity/v3/users/981cea07cb31407f96c8fe19b9754fee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:34.257238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.258749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:34.280495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823372-66d9-4cfc-a4db-ff847d97a601 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.355141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.356149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.356458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.356726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] PATH_INFO: `/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.357943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b4e49b76ca468c8c70fc0e0b5157df)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.360008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.419658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b4e49b76ca468c8c70fc0e0b5157df', 'request_id': 'req-2593ddc4-7357-42d0-bcb1-743fbd415103'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:34.426132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b4e49b76ca468c8c70fc0e0b5157df', 'request_id': 'req-2593ddc4-7357-42d0-bcb1-743fbd415103'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:34.435100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b4e49b76ca468c8c70fc0e0b5157df', 'request_id': 'req-2593ddc4-7357-42d0-bcb1-743fbd415103'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:34.448351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] The token cache is being invalidate because project 34b4e49b76ca468c8c70fc0e0b5157df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:34.448818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:34.449716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2593ddc4-7357-42d0-bcb1-743fbd415103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:34.451323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1075/2182] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:34 2022] DELETE /identity/v3/projects/34b4e49b76ca468c8c70fc0e0b5157df => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:34.456901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.457477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.457820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.488405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:34.489861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:34.576543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1108/2183] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:34.584491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833ab9-1582-4844-9635-9f5068991873 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.584994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833ab9-1582-4844-9635-9f5068991873 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.585084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75833ab9-1582-4844-9635-9f5068991873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.604708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-75833ab9-1582-4844-9635-9f5068991873 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:34.605981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-75833ab9-1582-4844-9635-9f5068991873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:34.618104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1076/2184] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:34.624381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.635038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69d50-6e84-4966-bf77-f5d8a3bca240 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.640237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.640989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.641376 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.641686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.643117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:34.643498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.645210 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.657621 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1109/2185] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 19:57:34.662196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75833ab9-1582-4844-9635-9f5068991873 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.671695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75833ab9-1582-4844-9635-9f5068991873 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.678657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.678987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.679288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.679729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.681716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.687717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.719660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1077/2186] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:34.724435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.734538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d7490-f067-44af-aa43-3d0ea7150faf admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.793852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.794618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.794934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.795242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.795941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.797886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.816763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1110/2187] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:34 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:34.821037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.831821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953701f-4fb5-40c7-b225-f85f5731e45f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.836437 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.837087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.837371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.837648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.838376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.840025 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.850122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1078/2188] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:34.853972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.863983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c98c6-c85f-4fcf-b672-3bc78bfdcb98 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.868623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.869280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.869589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.869871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.870653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.872260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf410-f88b-4f6e-989d-3533d0f368e5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.882676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1111/2189] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:34.886577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:34.896985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f7d4-2f28-4c09-b5b9-2389b2e60f79 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:34.901553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:34.902410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.902728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.903008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] PATH_INFO: `/v3/projects/9e3dfcdf5156479a9e8241de40c27ebf/users/d0a8d6195c1c4f0b8d9531a0b2137546/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.917909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3dfcdf5156479a9e8241de40c27ebf, user_id=d0a8d6195c1c4f0b8d9531a0b2137546, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:34.920532 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:34.932649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1079/2190] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:34 2022] PUT /identity/v3/projects/9e3dfcdf5156479a9e8241de40c27ebf/users/d0a8d6195c1c4f0b8d9531a0b2137546/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:34.943227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:34.943541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:34.943819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:34.971671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] MFA Rules not processed for user `d0a8d6195c1c4f0b8d9531a0b2137546`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:34.972832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:35.035749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1112/2191] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:35.040249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.101984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619d7b-1c3d-460c-885e-be9614b5a5d5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.106694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.107291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.107573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.107852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.108554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.110480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.141525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1080/2192] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:35.143111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.154267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88187-e7c7-4680-acf7-0e83bb2d4941 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.214662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.215355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.215794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.216076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.216936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.218947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.242532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1113/2193] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:35.245942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.258016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dab06a-1d28-4bf2-a921-83af95f9825b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.262759 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.263423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.263732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.264005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.264737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.266360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.281255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1081/2194] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:35.285345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.296103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1740d-0418-4863-9074-d37747e055c2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.305971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.306848 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.307309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.308459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.309352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.311810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2228b4-47d7-4ebf-a9c7-bd62ff80545f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.327751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1114/2195] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:35.328972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.339221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8dde-3bc3-4582-b660-3fceb4dfc7da admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.345036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.346096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.347323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.347323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] PATH_INFO: `/v3/projects/5882e127f42946aaaeacf4062cddbfb3/users/70ef69ab1ee24212943f317d16709dba/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.364076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5882e127f42946aaaeacf4062cddbfb3, user_id=70ef69ab1ee24212943f317d16709dba, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.367118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.382334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1082/2196] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:35 2022] PUT /identity/v3/projects/5882e127f42946aaaeacf4062cddbfb3/users/70ef69ab1ee24212943f317d16709dba/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:35.394084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.394375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.394686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.432863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] MFA Rules not processed for user `70ef69ab1ee24212943f317d16709dba`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:35.434498 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:35.500588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1115/2197] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:35.505224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.571541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d315-c521-4f38-a6c4-a42c1d6e5466 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.576220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.576882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.577167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.577447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.578174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.580169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.604712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1083/2198] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:35.608844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.619832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17f6b-60fe-4c7a-bd31-92ef426b862d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.672797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.673450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.673788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.674596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.675275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.677201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.700220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1116/2199] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:35.701416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.711582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bfe30-fc4c-44f0-b3b1-6ae36a6ebf34 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.716132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.716830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.717117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.717395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.718115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.719752 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.730716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1084/2200] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:35.734886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.745443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ffee4-6f88-4ea9-af13-aa4d4ddba077 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.750688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.751506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.751894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.752080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] PATH_INFO: `/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d/users/c00f2392b07f4f3eb0b413c21e223960/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.768051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48619d25523c4c4ab2fdf546e75f4d8d, user_id=c00f2392b07f4f3eb0b413c21e223960, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.770741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.783166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1117/2201] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:35 2022] PUT /identity/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d/users/c00f2392b07f4f3eb0b413c21e223960/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:35.787641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.798318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cfc3a-93d6-48f0-9024-ca2c7e66c6ac admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.854381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.855073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.855348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.855619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.856336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.857991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44dcb48-bfdd-463c-8aba-708208ccd18c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.867420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1085/2202] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:35.871631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:35.881751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884625a-3042-4ccf-9b43-9cde0c35c444 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:35.886224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:35.887197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.887484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.887758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] PATH_INFO: `/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d/users/c00f2392b07f4f3eb0b413c21e223960/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.889701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48619d25523c4c4ab2fdf546e75f4d8d, user_id=c00f2392b07f4f3eb0b413c21e223960, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:35.892349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:35.902466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1118/2203] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:35 2022] PUT /identity/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d/users/c00f2392b07f4f3eb0b413c21e223960/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:35.912972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:35.913268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:35.913552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:35.939132 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] MFA Rules not processed for user `c00f2392b07f4f3eb0b413c21e223960`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:35.940341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:36.008579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1086/2204] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:36.020333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:36.022008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:36.076690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4bdc-cdbc-4284-95ad-74ac06e58907 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:36.080905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:36.081545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:36.081827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:36.082101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:36.091416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:36.093122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:36.103947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1119/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:36.146541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:36.147938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:36.159644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308927c5-aaf3-43fa-9d09-310a7b2850d6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:36.163261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:36.163893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:36.164175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:36.164450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:36.219311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:36.220743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:36.229545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1087/2206] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:38.084481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:38.085975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:38.162945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f10637-dc1b-4d8a-bd16-c92b1995587a service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:38.171913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:38.174636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:38.175522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:38.175809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:38.176086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] PATH_INFO: `/v3/users/349f5b26cc53453ab5a86461893f03fa` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:38.177315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349f5b26cc53453ab5a86461893f03fa)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:38.179319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:38.182136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2c3ae-025f-4e1e-8ee1-e08a4c12cd85 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:38.185951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:38.186641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:38.186929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:38.187206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:38.189520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:38.249472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349f5b26cc53453ab5a86461893f03fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:38.258607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349f5b26cc53453ab5a86461893f03fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:38.269204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349f5b26cc53453ab5a86461893f03fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:38.270045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349f5b26cc53453ab5a86461893f03fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:38.271107 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a7c6844f-7f7d-4a46-8673-1fbb6518c415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349f5b26cc53453ab5a86461893f03fa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:38.275939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:38.277444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:38.292938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1120/2207] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:38 2022] DELETE /identity/v3/users/349f5b26cc53453ab5a86461893f03fa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:38.294999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1088/2208] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:38.300900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:38.301193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:38.301555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:38.330998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:38.332184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:38.418329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1121/2209] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:38.435659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:38.437228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:38.514444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc6231-6b3f-4bb8-a425-17fd0bcfa71d service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:38.596485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:38.597143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:38.597756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:38.597756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:38.608719 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:38.613952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:38.621033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1089/2210] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:39.008420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.010164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.039460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61cd0d-f8d9-4ca1-a787-5e13e00fa89b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.045109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.046802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.047310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.047770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] PATH_INFO: `/v3/projects/1b0e1fbc10194ae8ad3f54f19e735430` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.050144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0e1fbc10194ae8ad3f54f19e735430)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.053468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.108474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.109208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0e1fbc10194ae8ad3f54f19e735430', 'request_id': 'req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.111646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.116713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0e1fbc10194ae8ad3f54f19e735430', 'request_id': 'req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.124351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0e1fbc10194ae8ad3f54f19e735430', 'request_id': 'req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.133246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d532-9768-404b-b3ae-e4952461e572 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.141456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] The token cache is being invalidate because project 1b0e1fbc10194ae8ad3f54f19e735430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:39.141456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.142871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.148074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1122/2211] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/projects/1b0e1fbc10194ae8ad3f54f19e735430 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:39.148885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.150290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.200318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.201176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.201541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.201813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] PATH_INFO: `/v3/users/9907f31f59134c78891a7e45b998e9ea` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.203034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9907f31f59134c78891a7e45b998e9ea)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.204967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.215684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2a3a-b329-4589-bc22-7ac7667b6e7e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.221359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.222310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.222641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.222919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] PATH_INFO: `/v3/users/409eefa029034b31b68bba3e8745b03d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.224173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=409eefa029034b31b68bba3e8745b03d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.226121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.262094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9907f31f59134c78891a7e45b998e9ea'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.269443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9907f31f59134c78891a7e45b998e9ea'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.270218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9907f31f59134c78891a7e45b998e9ea'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.282058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9907f31f59134c78891a7e45b998e9ea'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.282831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9907f31f59134c78891a7e45b998e9ea'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.286625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409eefa029034b31b68bba3e8745b03d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.294616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409eefa029034b31b68bba3e8745b03d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.296909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1090/2212] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/users/9907f31f59134c78891a7e45b998e9ea => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:39.298107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.300125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.311313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409eefa029034b31b68bba3e8745b03d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.311997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409eefa029034b31b68bba3e8745b03d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.312666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ac82c9a-0cbf-4d01-aa6a-23446e1ac20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409eefa029034b31b68bba3e8745b03d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.332329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1123/2213] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/users/409eefa029034b31b68bba3e8745b03d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:39.369523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8faf-6ccc-4869-b8ae-dc5fc26179a3 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.429255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.430160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.430442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.430819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] PATH_INFO: `/v3/users/d0a8d6195c1c4f0b8d9531a0b2137546` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.432045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a8d6195c1c4f0b8d9531a0b2137546)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.433967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.482591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a8d6195c1c4f0b8d9531a0b2137546'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.490193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a8d6195c1c4f0b8d9531a0b2137546'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.491007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a8d6195c1c4f0b8d9531a0b2137546'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.503648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a8d6195c1c4f0b8d9531a0b2137546'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.504389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a8d6195c1c4f0b8d9531a0b2137546'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.516865 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1091/2214] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/users/d0a8d6195c1c4f0b8d9531a0b2137546 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:39.521937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.522230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.522538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.542162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:39.543997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.585973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.587972 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.610717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1124/2215] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:39.618141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.619734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.655920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525c14-95b7-4b65-8e48-7f127f85d68a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.661781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.663043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.663333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.663613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] PATH_INFO: `/v3/projects/ef09b07e216740248983d75373a66876` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.664831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef09b07e216740248983d75373a66876)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.666853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.691112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abe400-8d80-435c-b6c9-0b924f7159ac None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.698867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.699655 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.700064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.700436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.713304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.714870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.720509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef09b07e216740248983d75373a66876', 'request_id': 'req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.726099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1125/2216] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:39.727382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef09b07e216740248983d75373a66876', 'request_id': 'req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.741344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef09b07e216740248983d75373a66876', 'request_id': 'req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.760069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] The token cache is being invalidate because project ef09b07e216740248983d75373a66876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:39.760819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.761338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.762043 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.762413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.766339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1092/2217] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/projects/ef09b07e216740248983d75373a66876 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:39.774319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:39.774319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:39.788024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c16a74-acd7-4bf6-8234-78ece4faf5b4 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.850351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba09d-a7b5-426b-b919-d9b41e5a310f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:39.858960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.859989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.860384 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.860825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] PATH_INFO: `/v3/users/a1eb027a24844054a1d43b5dccaaf618` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.862850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1eb027a24844054a1d43b5dccaaf618)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.865066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.866968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:39.867838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.868120 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.868397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] PATH_INFO: `/v3/projects/8154dc595da74b7292f0f79817efabdd` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.869664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8154dc595da74b7292f0f79817efabdd)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:39.871729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:39.919541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1eb027a24844054a1d43b5dccaaf618'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.926252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8154dc595da74b7292f0f79817efabdd', 'request_id': 'req-9807f811-8cfc-45fb-b09c-5f9a13db94ab'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.927213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1eb027a24844054a1d43b5dccaaf618'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.928039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1eb027a24844054a1d43b5dccaaf618'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.933337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8154dc595da74b7292f0f79817efabdd', 'request_id': 'req-9807f811-8cfc-45fb-b09c-5f9a13db94ab'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.939972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8154dc595da74b7292f0f79817efabdd', 'request_id': 'req-9807f811-8cfc-45fb-b09c-5f9a13db94ab'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.941002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1eb027a24844054a1d43b5dccaaf618'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.941801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1eb027a24844054a1d43b5dccaaf618'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.954450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] The token cache is being invalidate because project 8154dc595da74b7292f0f79817efabdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:39.955084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.955853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9807f811-8cfc-45fb-b09c-5f9a13db94ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:39.957691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1126/2218] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/projects/8154dc595da74b7292f0f79817efabdd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:39.961021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1093/2219] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:39 2022] DELETE /identity/v3/users/a1eb027a24844054a1d43b5dccaaf618 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:39.965577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32b95-6722-469d-bce7-875ea7eb7e8e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:39.965876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32b95-6722-469d-bce7-875ea7eb7e8e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:39.966155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32b95-6722-469d-bce7-875ea7eb7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:39.987081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-34a32b95-6722-469d-bce7-875ea7eb7e8e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:39.988733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-34a32b95-6722-469d-bce7-875ea7eb7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.053321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.055209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.060716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1127/2220] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:40.068286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc621-4912-441c-8a24-4026b5105cde None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.068758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc621-4912-441c-8a24-4026b5105cde None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.069132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fc621-4912-441c-8a24-4026b5105cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.073998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375cfa-11fe-465e-b522-b79a517741d9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.090833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-898fc621-4912-441c-8a24-4026b5105cde None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:40.092240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-898fc621-4912-441c-8a24-4026b5105cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.096166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.097912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.098869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.099310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] PATH_INFO: `/v3/projects/9e3dfcdf5156479a9e8241de40c27ebf` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.100990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3dfcdf5156479a9e8241de40c27ebf)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.102297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1128/2221] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:40.103623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.107273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fc621-4912-441c-8a24-4026b5105cde None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.120137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fc621-4912-441c-8a24-4026b5105cde None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.128595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.129390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.129682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.130056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.132240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:40.134858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.137912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.151444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1129/2222] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:40.156263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.167226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47020ec-6db8-48b2-a28a-5ab95af7f4b6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.172770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3dfcdf5156479a9e8241de40c27ebf', 'request_id': 'req-f968afbe-203b-4372-b2ae-d94705733cec'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.182292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3dfcdf5156479a9e8241de40c27ebf', 'request_id': 'req-f968afbe-203b-4372-b2ae-d94705733cec'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.196905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3dfcdf5156479a9e8241de40c27ebf', 'request_id': 'req-f968afbe-203b-4372-b2ae-d94705733cec'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.210012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] The token cache is being invalidate because project 9e3dfcdf5156479a9e8241de40c27ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:40.210012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.211250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.213381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1094/2223] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:40 2022] DELETE /identity/v3/projects/9e3dfcdf5156479a9e8241de40c27ebf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:40.217568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.219519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.246617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.247486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.248102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.248894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.249660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.251693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.300129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1130/2224] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:40.301282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.305510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.349827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968afbe-203b-4372-b2ae-d94705733cec admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.394191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2b18-f2cf-4e7e-8954-8de3d1f9a40f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.401146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.402704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.403061 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.403508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] PATH_INFO: `/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.405466 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e035d66fd5a24ebe8ce34ca0b6a4d5f2)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.409337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.432517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.433930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.434395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.434900 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] PATH_INFO: `/v3/users/70ef69ab1ee24212943f317d16709dba` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.437263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ef69ab1ee24212943f317d16709dba)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.442749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.471277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e035d66fd5a24ebe8ce34ca0b6a4d5f2', 'request_id': 'req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.477369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e035d66fd5a24ebe8ce34ca0b6a4d5f2', 'request_id': 'req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.483075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e035d66fd5a24ebe8ce34ca0b6a4d5f2', 'request_id': 'req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.493738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ef69ab1ee24212943f317d16709dba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.496825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] The token cache is being invalidate because project e035d66fd5a24ebe8ce34ca0b6a4d5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:40.497140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.497793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.499731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1131/2225] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:40 2022] DELETE /identity/v3/projects/e035d66fd5a24ebe8ce34ca0b6a4d5f2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:40.503342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.503468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ef69ab1ee24212943f317d16709dba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.503468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ef69ab1ee24212943f317d16709dba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.504442 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.513876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ef69ab1ee24212943f317d16709dba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.514563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-73e4c055-52cc-4512-8f71-959c2494c13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ef69ab1ee24212943f317d16709dba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:40.529978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1095/2226] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:40 2022] DELETE /identity/v3/users/70ef69ab1ee24212943f317d16709dba => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:40.531461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b7ec-62e7-4d97-a9b5-5add44812e58 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.531822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b7ec-62e7-4d97-a9b5-5add44812e58 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.532112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b7ec-62e7-4d97-a9b5-5add44812e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.556058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1466b7ec-62e7-4d97-a9b5-5add44812e58 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:40.557389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1466b7ec-62e7-4d97-a9b5-5add44812e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.575565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b3ac-4f54-44c2-be5d-fc0907d3e8b6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.635823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1096/2227] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:40.641303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.642123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.643539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.643539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.644453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.645611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.646058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.646724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.646925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.669256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1132/2228] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/users => generated 280 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:40.674184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:40.674184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.678430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.680716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.682817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1097/2229] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:40.687209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.693828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47622e-0887-423e-996d-d407059800fc admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.696736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134d60-dc15-4d32-901c-75721ac96c7d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.703256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.703256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.703256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.703256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.703795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.704448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.711905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.712917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.713522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.714041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.715026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:40.716016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.716305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1133/2230] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:40.719053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.722161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.736222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1098/2231] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:40.736403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3643-4402-49cf-8bb2-5bbeeaae786c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.737665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.739211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.739886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.740176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.740460 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.741195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.742872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.748732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b8f8b-64cd-41c2-a3ab-8f1e5d366d97 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.754816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1134/2232] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:40.755315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.756416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.756767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.757111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.759161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.759306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.761258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.769673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398fb22-35e6-4fcc-95c6-87f9af3f10dc admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.780855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.781769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.782054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.782343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] PATH_INFO: `/v3/projects/81ab9bbcafe943f89f2622e6d9486ac1/users/799f49603f3d41178c299689a32716aa/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.793616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1099/2233] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:40.794512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.799677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ab9bbcafe943f89f2622e6d9486ac1, user_id=799f49603f3d41178c299689a32716aa, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.802349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744293-e25e-42f8-8d10-6f90a14d9071 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.827403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1135/2234] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:40 2022] PUT /identity/v3/projects/81ab9bbcafe943f89f2622e6d9486ac1/users/799f49603f3d41178c299689a32716aa/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:40.834914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.835440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.835722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.863229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] MFA Rules not processed for user `799f49603f3d41178c299689a32716aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:40.864587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.868588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e2d19-68b0-474b-8ece-5eebbd9db8cf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.936561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.937329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.937688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.938033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.938831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.941430 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.942686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1136/2235] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:40.943575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.945170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:40.966170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718054d-a23d-484a-bde5-4fbfc52b780e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.970995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1100/2236] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:40 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:40.972078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:40.972942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:40.973231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:40.973581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] PATH_INFO: `/v3/projects/5882e127f42946aaaeacf4062cddbfb3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:40.974840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5882e127f42946aaaeacf4062cddbfb3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:40.976777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:40.979514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:40.989965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f0eb5-efb3-4af6-8eed-f657e101d2c3 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:40.999458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.000137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.000424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.000703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.001444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.004672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.019789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1101/2237] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:41.019789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.019789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.029837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5882e127f42946aaaeacf4062cddbfb3', 'request_id': 'req-bd75c1f5-cadc-4b9d-b390-cc2133898755'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.036736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5882e127f42946aaaeacf4062cddbfb3', 'request_id': 'req-bd75c1f5-cadc-4b9d-b390-cc2133898755'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.042302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5882e127f42946aaaeacf4062cddbfb3', 'request_id': 'req-bd75c1f5-cadc-4b9d-b390-cc2133898755'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.058521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] The token cache is being invalidate because project 5882e127f42946aaaeacf4062cddbfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:41.058820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.059503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.061078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1137/2238] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:40 2022] DELETE /identity/v3/projects/5882e127f42946aaaeacf4062cddbfb3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:41.061842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.063174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.082215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c91be-4046-4b98-aca7-4a64df315bc9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.137818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1f5-cadc-4b9d-b390-cc2133898755 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.142556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.143220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.143532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.143808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.144585 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.146133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.146275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.146821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.147106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.147381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.149176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.156336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1138/2239] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:41.157150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.160840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.174754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f64a32-0f9e-48b3-9c85-edf8bb820289 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.179752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.180601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.180885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.181153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] PATH_INFO: `/v3/users/c00f2392b07f4f3eb0b413c21e223960` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.182339 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00f2392b07f4f3eb0b413c21e223960)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.184301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.212614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.214073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.223496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1102/2240] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:41.224280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.234518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00f2392b07f4f3eb0b413c21e223960'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.237899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6c25f-fdc1-4521-89c2-73c922004b9e service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.242121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00f2392b07f4f3eb0b413c21e223960'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.243310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.244317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.244626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.244876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] PATH_INFO: `/v3/projects/24d8122b8bfe4c5eaccbc60315f1e4ba/users/a66d7b184d4d48c19d823a052c102883/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.251179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00f2392b07f4f3eb0b413c21e223960'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.252454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00f2392b07f4f3eb0b413c21e223960'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.253114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00f2392b07f4f3eb0b413c21e223960'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.262484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d8122b8bfe4c5eaccbc60315f1e4ba, user_id=a66d7b184d4d48c19d823a052c102883, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.265137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfb769-1c80-4d07-9833-79acb27b7fa3 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.270546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1139/2241] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:41 2022] DELETE /identity/v3/users/c00f2392b07f4f3eb0b413c21e223960 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:41.271551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.272914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.282642 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1103/2242] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:41 2022] PUT /identity/v3/projects/24d8122b8bfe4c5eaccbc60315f1e4ba/users/a66d7b184d4d48c19d823a052c102883/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:41.293654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.293654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.293958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.325951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] MFA Rules not processed for user `a66d7b184d4d48c19d823a052c102883`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:41.328705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.346844 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548107c3-b4c1-478d-825b-069cd29c218c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.426236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1104/2243] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:41.426439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.426439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.426439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.426439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] PATH_INFO: `/v3/users/799f49603f3d41178c299689a32716aa` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.426838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799f49603f3d41178c299689a32716aa)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.427362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.433908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.435448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.482321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799f49603f3d41178c299689a32716aa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.491958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799f49603f3d41178c299689a32716aa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.503526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799f49603f3d41178c299689a32716aa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.504274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799f49603f3d41178c299689a32716aa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.507117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a9717475-72e3-46d6-a1bd-e2978da1d254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799f49603f3d41178c299689a32716aa'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.535813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1140/2244] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:41 2022] DELETE /identity/v3/users/799f49603f3d41178c299689a32716aa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:41.540173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.540953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.541456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.549705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdb8b1-0664-41e1-a83f-28e899c01ba5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.566160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:41.567768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.613141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.614050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.614412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.614735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.616629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.641362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1141/2245] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:41.648167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.651804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.690587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.692033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.701325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1105/2246] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:41.702140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.703677 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.724913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b640-f87f-47fc-9111-607a5f807d18 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.730015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.730929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.731217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.731497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] PATH_INFO: `/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.732773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48619d25523c4c4ab2fdf546e75f4d8d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.734761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.735842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d097933-0942-4fbb-8ea9-ac7cb846bebb None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:41.740098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:41.740748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.741015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.741459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.753683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:41.755329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4786f5d-e9bd-42fe-9995-1e80cc0e57c2 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:41.769699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1142/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:57:41.793465 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48619d25523c4c4ab2fdf546e75f4d8d', 'request_id': 'req-68caf6de-7f15-406d-b9af-33cbc6e83d0b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.800557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48619d25523c4c4ab2fdf546e75f4d8d', 'request_id': 'req-68caf6de-7f15-406d-b9af-33cbc6e83d0b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.809557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48619d25523c4c4ab2fdf546e75f4d8d', 'request_id': 'req-68caf6de-7f15-406d-b9af-33cbc6e83d0b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.823514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] The token cache is being invalidate because project 48619d25523c4c4ab2fdf546e75f4d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:41.823905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.824994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-68caf6de-7f15-406d-b9af-33cbc6e83d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:41.827315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1106/2248] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:41 2022] DELETE /identity/v3/projects/48619d25523c4c4ab2fdf546e75f4d8d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:41.833670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.834011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.834346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.856109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:41.857527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.929800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1143/2249] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:41.939745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:41.940037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:41.940309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:41.962192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:41.964499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:41.978692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1107/2250] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:41.980821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:41.993941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c4e10-3870-4bd2-a53d-9313b77dbf87 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.000944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.001910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.002317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.002478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.003232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:42.003537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.005142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.027756 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.030713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1144/2251] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:42.035403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940aab-a06d-415d-93ae-ffb78a55464d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.040474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.041135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.041415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.041751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.042441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.044754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.072687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1108/2252] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:42 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:42.077967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.091986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82eb06-db2c-4d03-a32d-a4d6eb50a045 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.099679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.101483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.157300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.158008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.158286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.158601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.159298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.161233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.170045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0cab8-9113-4f58-8176-df164990dfb8 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.175629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.176959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.177248 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.177510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] PATH_INFO: `/v3/projects/81ab9bbcafe943f89f2622e6d9486ac1` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.179045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ab9bbcafe943f89f2622e6d9486ac1)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.181000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.185516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1145/2253] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:42 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:42.186558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.196699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d010-93be-4c02-8775-8d5a1268b234 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.201424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.202072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.202415 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.202735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.203485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.205690 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.215967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1146/2254] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:42.219871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.227341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ab9bbcafe943f89f2622e6d9486ac1', 'request_id': 'req-caae7a8a-abf7-4306-9f3e-c22f13944188'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.229836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5856-cc1d-499a-a87b-670abfef1464 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.234003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ab9bbcafe943f89f2622e6d9486ac1', 'request_id': 'req-caae7a8a-abf7-4306-9f3e-c22f13944188'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.242138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ab9bbcafe943f89f2622e6d9486ac1', 'request_id': 'req-caae7a8a-abf7-4306-9f3e-c22f13944188'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.253676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] The token cache is being invalidate because project 81ab9bbcafe943f89f2622e6d9486ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:42.253964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.254632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.256194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1109/2255] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:42 2022] DELETE /identity/v3/projects/81ab9bbcafe943f89f2622e6d9486ac1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:42.293961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.294673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.295011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.295289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.296149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.297814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716818-7f74-4e17-857d-3382f14de387 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.309303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1147/2256] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:42.313837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.316099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.333138 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7a8a-abf7-4306-9f3e-c22f13944188 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.338260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.339224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.339508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.339798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] PATH_INFO: `/v3/projects/197b828cb1e84d5a92645a5c48706bea/users/ddec9740463d4151b8a7d58515d09acf/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.357559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197b828cb1e84d5a92645a5c48706bea, user_id=ddec9740463d4151b8a7d58515d09acf, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.360314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.377552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1110/2257] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:42 2022] PUT /identity/v3/projects/197b828cb1e84d5a92645a5c48706bea/users/ddec9740463d4151b8a7d58515d09acf/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:42.390282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.390741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.391089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.420931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] MFA Rules not processed for user `ddec9740463d4151b8a7d58515d09acf`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:42.422139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.493496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1148/2258] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:42.508072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.509804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.568486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e162412-1352-41d0-a5ce-cf74b11ed449 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.571241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.571883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.572167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.572445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.580613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.582079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad94393-0ea4-4cf8-829c-39428898db08 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.590658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1111/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:42.609334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.678452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b749-d469-4acf-bc2d-f68659b78b02 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.686076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.687693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.688217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.688743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] PATH_INFO: `/v3/users/ddec9740463d4151b8a7d58515d09acf` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.692488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddec9740463d4151b8a7d58515d09acf)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.696304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.747595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddec9740463d4151b8a7d58515d09acf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.757451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddec9740463d4151b8a7d58515d09acf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.766639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddec9740463d4151b8a7d58515d09acf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.767587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddec9740463d4151b8a7d58515d09acf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.768231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddec9740463d4151b8a7d58515d09acf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:42.793334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1149/2260] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:42 2022] DELETE /identity/v3/users/ddec9740463d4151b8a7d58515d09acf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:42.797909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.798282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.799175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.817070 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:42.818270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.889915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1112/2261] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:42.899767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:42.901188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:42.963532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f8709-2b87-43c1-b122-6092866d8faa admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:42.967492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:42.968139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:42.968422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:42.968696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:42.978904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:42.980351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba1e81-0872-44c4-b087-2d0bd89cf82b service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:42.990487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1150/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:43.466034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.467511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:43.483178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cf519-02cf-4f7c-bcc1-5e18e1fae93b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.488411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.489333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.489621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.489901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] PATH_INFO: `/v3/projects/197b828cb1e84d5a92645a5c48706bea` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.491130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197b828cb1e84d5a92645a5c48706bea)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.493092 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.563144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197b828cb1e84d5a92645a5c48706bea', 'request_id': 'req-2668720d-64d1-40a3-b91f-90573e0c7514'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:43.570153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197b828cb1e84d5a92645a5c48706bea', 'request_id': 'req-2668720d-64d1-40a3-b91f-90573e0c7514'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:43.577291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197b828cb1e84d5a92645a5c48706bea', 'request_id': 'req-2668720d-64d1-40a3-b91f-90573e0c7514'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:43.588720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] The token cache is being invalidate because project 197b828cb1e84d5a92645a5c48706bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:43.589008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:43.589656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-2668720d-64d1-40a3-b91f-90573e0c7514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:43.591231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1113/2263] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:43 2022] DELETE /identity/v3/projects/197b828cb1e84d5a92645a5c48706bea => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:43.596637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.597099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.597204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.614662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:43.615878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:43.674359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1151/2264] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:43.682069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.682364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.682680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.702230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:43.703484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:43.712411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1114/2265] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:43.716760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.726277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a3dcb-4341-41d6-bbc4-fe60bf09db8b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.730878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.731525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.731814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.732093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.732826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:43.733137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.734777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.745947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1152/2266] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:43.750635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.760382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff14652-3e33-441d-ba7d-7e0ffac0d5e2 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.765014 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.765664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.765947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.766225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.766952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.769448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.794786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1115/2267] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:43 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:43.798674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.810912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8cb7-4aad-47d1-a3d9-bb4d18ad4580 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.869151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.869824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.870116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.870398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.871135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.873340 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.898966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1153/2268] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:43 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:43.900235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.910794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b442-5c6a-4d61-ac34-150e50d22d1e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.915640 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.916295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.916580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.916851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.917591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.919249 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.932395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1116/2269] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:43.936313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.946896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5df17-e4df-49d0-9771-5e30cdc076ef admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.951626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.952383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.952665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.952942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:43.953672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:43.955944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc68272-8c94-4ee5-8342-a7a6229edfb1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:43.971612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:43.972040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1154/2270] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:43.981905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bdcf5-f13d-400f-929e-d2d7aa305330 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:43.987801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:43.988582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:43.988930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:43.989274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] PATH_INFO: `/v3/projects/1a1d19ba25b54a51ba2bdbc9c0701dfd/users/7156a75fa0cd45bea9a6d256f4a7a669/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:44.012491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1d19ba25b54a51ba2bdbc9c0701dfd, user_id=7156a75fa0cd45bea9a6d256f4a7a669, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:44.015328 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:44.029889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1117/2271] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:43 2022] PUT /identity/v3/projects/1a1d19ba25b54a51ba2bdbc9c0701dfd/users/7156a75fa0cd45bea9a6d256f4a7a669/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:44.041226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:44.041794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:44.042078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:44.070487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] MFA Rules not processed for user `7156a75fa0cd45bea9a6d256f4a7a669`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:44.071715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:44.150990 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1155/2272] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:44.167610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:44.169325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:44.228960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f9b6-b6f2-4b5b-8eb8-2eda65273ee4 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:44.232771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:44.233418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:44.233704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:44.233982 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:44.242554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:44.244086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd23d32-3879-43ae-82ba-b3ccf5eb5035 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:44.254279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1118/2273] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:51.417761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:51.419198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:51.481074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5378-bf83-4ddd-acd4-a82c6759da9f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:51.485541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:51.486394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:51.486701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:51.487480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] PATH_INFO: `/v3/users/a66d7b184d4d48c19d823a052c102883` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:51.488651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66d7b184d4d48c19d823a052c102883)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:51.490588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:51.535699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66d7b184d4d48c19d823a052c102883'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:51.542766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66d7b184d4d48c19d823a052c102883'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:51.550387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66d7b184d4d48c19d823a052c102883'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:51.551048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66d7b184d4d48c19d823a052c102883'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:51.551654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66d7b184d4d48c19d823a052c102883'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:51.568509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1156/2274] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:57:51 2022] DELETE /identity/v3/users/a66d7b184d4d48c19d823a052c102883 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:57:51.573065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:51.573514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:51.573605 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:51.589998 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:51.591255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:51.648126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1119/2275] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:57:51.657640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:51.659127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:51.713713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7709639-ae04-4c7d-90cb-90c4bb184082 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:51.717486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:51.718114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:51.718394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:51.718781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:51.727813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:51.729249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6b8f-48b5-4288-8ac2-1fc6fda027fe service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:51.738944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1157/2276] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:57:52.010854 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.012340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:52.024860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b6275-7541-4c62-acae-ca205aa92a2d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.041236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.042374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.042796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.043454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] PATH_INFO: `/v3/projects/24d8122b8bfe4c5eaccbc60315f1e4ba` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.044325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d8122b8bfe4c5eaccbc60315f1e4ba)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.046807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.103745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d8122b8bfe4c5eaccbc60315f1e4ba', 'request_id': 'req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:52.110339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d8122b8bfe4c5eaccbc60315f1e4ba', 'request_id': 'req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:52.118875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d8122b8bfe4c5eaccbc60315f1e4ba', 'request_id': 'req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:52.131470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] The token cache is being invalidate because project 24d8122b8bfe4c5eaccbc60315f1e4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:57:52.131757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:52.132385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-84aefc22-1c33-4271-b1d7-d31dda7ff5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:57:52.133943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1120/2277] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:57:52 2022] DELETE /identity/v3/projects/24d8122b8bfe4c5eaccbc60315f1e4ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:52.138853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.139140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.139413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.156360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:52.157535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:52.215117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1158/2278] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:52.224634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.224924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.225204 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.243148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:52.244327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:52.252224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1121/2279] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:52.256437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.265783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77209e-237c-4dc9-81ae-8377181ec2ef None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.270877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.271518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.271801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.272078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.272801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:57:52.273245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.276159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.287960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1159/2280] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:57:52.292030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.301088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915cdbf-3128-4930-a8fc-890672b8af44 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.305632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.306271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.306604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.306884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.307577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.309464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.336757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1122/2281] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:57:52 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:57:52.337759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.348197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595761-7abb-480b-bfd2-d4d7e6afc1ac admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.404042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.404711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.404996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.405272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.405978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.407938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.432008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1160/2282] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:57:52 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:57:52.433181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.443486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cd3c7-7e6b-4c10-8156-9b5ead0f88a5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.448101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.448757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.449038 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.449312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.450034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.451650 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.462675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1123/2283] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:57:52.466513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.476956 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4e72-a65e-4531-8335-1c5ffbe975c1 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.481622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.482283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.482614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.482903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.483665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.485229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdd1ac-5f21-4e5b-89d3-dc338a320ce1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.495455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1161/2284] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:57:52.499586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.509722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe600f94-a815-4bf1-879b-5387046f4eb2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.514342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.515267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.515544 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.515823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] PATH_INFO: `/v3/projects/bf5be273f26747ce865579f6d7c3ef41/users/9bd4a057a03b4c8db5866209b9fb4097/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.537116 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5be273f26747ce865579f6d7c3ef41, user_id=9bd4a057a03b4c8db5866209b9fb4097, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.540337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.553256 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1124/2285] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:57:52 2022] PUT /identity/v3/projects/bf5be273f26747ce865579f6d7c3ef41/users/9bd4a057a03b4c8db5866209b9fb4097/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:57:52.563702 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.564021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.564303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.590826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] MFA Rules not processed for user `9bd4a057a03b4c8db5866209b9fb4097`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:57:52.591948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:52.655507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1162/2286] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:57:52.666821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:57:52.668631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:57:52.723220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee795-8ce7-4185-b70e-bf9bbd28759d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:57:52.726811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:57:52.727439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:57:52.727717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:57:52.727990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:57:52.736073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:57:52.737510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5317c9-4009-46e5-8b40-58e33fc8c96f service glance] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:57:52.745927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1125/2287] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:57:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:09.103973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:09.105391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.169445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981507-360a-4e4d-b649-6d9606e2de05 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:09.173947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:09.174862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.175148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.175425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] PATH_INFO: `/v3/users/1ca8030d98de490580f9df7136a18bdb` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.176627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca8030d98de490580f9df7136a18bdb)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:09.178586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:09.225096 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca8030d98de490580f9df7136a18bdb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.231957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca8030d98de490580f9df7136a18bdb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.239216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca8030d98de490580f9df7136a18bdb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.239918 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca8030d98de490580f9df7136a18bdb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.240654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca8030d98de490580f9df7136a18bdb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.258105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1163/2288] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:09 2022] DELETE /identity/v3/users/1ca8030d98de490580f9df7136a18bdb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:09.262594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.263050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.263137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.280365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:09.281595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.342761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1126/2289] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:09.352683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:09.354241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.412048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e4987-684e-49a3-890c-5c2d62618f1c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:09.416056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:09.416709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.417026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.417304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.427259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:09.428701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8548f-764d-4006-abe7-83a599a7cef7 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:09.438185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1164/2290] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:09.715894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:09.717337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.735833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493e636-8b92-473f-9b89-2d8da87b906b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:09.741392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:09.742338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.742652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.742927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] PATH_INFO: `/v3/projects/c6577ac2d97d4d6080d4dcde1d00a0dc` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.744104 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6577ac2d97d4d6080d4dcde1d00a0dc)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:09.746223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:09.793838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6577ac2d97d4d6080d4dcde1d00a0dc', 'request_id': 'req-42248d8a-37fa-49aa-903b-660558cff464'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.799760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6577ac2d97d4d6080d4dcde1d00a0dc', 'request_id': 'req-42248d8a-37fa-49aa-903b-660558cff464'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.807614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6577ac2d97d4d6080d4dcde1d00a0dc', 'request_id': 'req-42248d8a-37fa-49aa-903b-660558cff464'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.818589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] The token cache is being invalidate because project c6577ac2d97d4d6080d4dcde1d00a0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:09.818882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.819523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-42248d8a-37fa-49aa-903b-660558cff464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:09.821064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1127/2291] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:09 2022] DELETE /identity/v3/projects/c6577ac2d97d4d6080d4dcde1d00a0dc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:09.825881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.826175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.826472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.843951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:09.845240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.907178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1165/2292] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:09.914717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.915002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.915277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.934226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:09.935448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:09.947019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1128/2293] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:09.948738 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:09.963679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e438ef-8ddc-401d-93a2-65472cb040b9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:09.968599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:09.969519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:09.969897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:09.970261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:09.971124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:58:09.971425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:09.973566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:09.985695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1166/2294] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:58:09.990304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:09.999889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a801-3733-466f-a4ba-4b82bca11205 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.004584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.005244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.005521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.005789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.006511 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.008381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.032590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1129/2295] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:09 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:58:10.037076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:10.046910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b4044-63f5-437c-b6a1-6c4eca409cdd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.102687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.103269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.103549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.103823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.104592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.106510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.127195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1167/2296] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:10.131356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:10.141955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640328-3266-4e51-8d4e-761b908ccea7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.147536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.148176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.148455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.148728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.149441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.151058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.161602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1130/2297] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:10.165424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:10.175246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5645f95-9c14-47a3-8b84-64914e7db77d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.179920 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.180570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.180856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.181134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.181854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.183485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0ac41-5e32-47c8-9879-ddac09384964 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.193039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1168/2298] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:10.197024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:10.206900 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4cf5b-abc1-43e6-9232-bb96cb5605c8 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.211940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.212806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.213089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.213368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] PATH_INFO: `/v3/projects/a4ea293f7e6f48d69e04cb1f4721f637/users/65bb39380bc54627a858d0dde96c9c4a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.227460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ea293f7e6f48d69e04cb1f4721f637, user_id=65bb39380bc54627a858d0dde96c9c4a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.230162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.243911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1131/2299] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:10 2022] PUT /identity/v3/projects/a4ea293f7e6f48d69e04cb1f4721f637/users/65bb39380bc54627a858d0dde96c9c4a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:10.254349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.254676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.254960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.280857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] MFA Rules not processed for user `65bb39380bc54627a858d0dde96c9c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:10.282063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:10.343162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1169/2300] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:10.354202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:10.355829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:10.411626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de65b7-3bec-4fb1-8af5-9a99b74b6e6b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:10.415308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:10.415947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:10.416232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:10.416508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:10.424782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:10.426209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f11f-3731-4694-a208-4a3e90953cc8 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:10.434902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1132/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:13.829152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:13.830655 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:13.901573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3abf6-0f75-4af0-80aa-302c18a24f04 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:13.906362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:13.907258 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:13.907604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:13.907796 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] PATH_INFO: `/v3/users/15fb7ac81f2c4b7fbe6672e7499e68d6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:13.909085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fb7ac81f2c4b7fbe6672e7499e68d6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:13.911117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:13.961458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fb7ac81f2c4b7fbe6672e7499e68d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:13.968169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fb7ac81f2c4b7fbe6672e7499e68d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:13.975789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fb7ac81f2c4b7fbe6672e7499e68d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:13.976677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fb7ac81f2c4b7fbe6672e7499e68d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:13.977301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fb7ac81f2c4b7fbe6672e7499e68d6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:13.995055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1170/2302] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:13 2022] DELETE /identity/v3/users/15fb7ac81f2c4b7fbe6672e7499e68d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:13.999881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:14.000370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:14.000463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:14.017879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:14.019114 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:14.077674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1133/2303] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:14.087555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:14.088955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:14.146010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753fa21-d077-49f5-b9af-a003fa8ac07a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:14.149553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:14.150189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:14.150516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:14.150811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:14.159546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:14.161623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:14.170946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1171/2304] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:58:14.451918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:14.453565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:14.466767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7007ab0-78ed-44c9-ab1e-5ad46f2e2876 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:14.474554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:14.475387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:14.475754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:14.475928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] PATH_INFO: `/v3/projects/78ca9238f82b48b18f978a3759851409` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:14.477220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ca9238f82b48b18f978a3759851409)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:14.479481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:14.551144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ca9238f82b48b18f978a3759851409', 'request_id': 'req-15feb0c4-d9a7-435e-83e5-e3d87e694478'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.562731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ca9238f82b48b18f978a3759851409', 'request_id': 'req-15feb0c4-d9a7-435e-83e5-e3d87e694478'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.571441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ca9238f82b48b18f978a3759851409', 'request_id': 'req-15feb0c4-d9a7-435e-83e5-e3d87e694478'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.587125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] The token cache is being invalidate because project 78ca9238f82b48b18f978a3759851409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:14.587531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.588333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.590142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1134/2305] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:14 2022] DELETE /identity/v3/projects/78ca9238f82b48b18f978a3759851409 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:14.594200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:14.604845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab114-e835-4ea0-9f87-b49163284833 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:14.669729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:14.670625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:14.670908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:14.671181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] PATH_INFO: `/v3/users/ead93838470243eeae0e4b2ac61be3bf` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:14.672390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead93838470243eeae0e4b2ac61be3bf)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:14.674387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:14.718721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead93838470243eeae0e4b2ac61be3bf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.725273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead93838470243eeae0e4b2ac61be3bf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.732194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead93838470243eeae0e4b2ac61be3bf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.732834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead93838470243eeae0e4b2ac61be3bf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.733422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3ae554a2-b11b-4d23-a7d6-927bac18b7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead93838470243eeae0e4b2ac61be3bf'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:14.751018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1172/2306] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:14 2022] DELETE /identity/v3/users/ead93838470243eeae0e4b2ac61be3bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:15.021393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.023412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:15.037892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feb0c4-d9a7-435e-83e5-e3d87e694478 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.100337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.101234 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.101509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.101782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] PATH_INFO: `/v3/projects/5d406fe616114fc986f4b76727ae3ed4` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.102980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d406fe616114fc986f4b76727ae3ed4)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.104981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.150479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d406fe616114fc986f4b76727ae3ed4', 'request_id': 'req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:15.156580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d406fe616114fc986f4b76727ae3ed4', 'request_id': 'req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:15.163895 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d406fe616114fc986f4b76727ae3ed4', 'request_id': 'req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:15.173587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] The token cache is being invalidate because project 5d406fe616114fc986f4b76727ae3ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:15.173870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:15.174577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acdd5032-4bb3-4dcb-b4c2-cf6ffb9de075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:15.176724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1135/2307] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:15 2022] DELETE /identity/v3/projects/5d406fe616114fc986f4b76727ae3ed4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:15.181581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.182060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.182163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.199524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:15.200894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:15.268447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1173/2308] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:15.276013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.276306 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.276592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.295750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:15.296987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:15.305277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1136/2309] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:15.309360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.320422 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ebf89-5a4e-4b5b-bc94-ca0b191ce616 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.328109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.328790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.329080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.329362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.330135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:58:15.330443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.332768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.345382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1174/2310] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:58:15.349690 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.359780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8582bb8-49b2-4624-aadc-acec5e8b0be6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.364475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.365124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.365410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.365688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.366376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.368348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.395066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1137/2311] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:15.399290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.409015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525fc0-dabf-4e8b-a173-de18b04c4134 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.466014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.466751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.467040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.467373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.468076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.470084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.489717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1175/2312] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:15 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:15.494088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.505786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc878f4-007c-4604-9a9e-b7984a410f1f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.510315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.511064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.511342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.511620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.512357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.513924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.524089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1138/2313] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:15.527998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.537836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945641f-2c01-443f-a53d-789336ab2c4a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.542393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.543086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.543372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.543681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.544402 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.546001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4f1dc-bbac-4bc7-b1c4-9a863007c01b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.556529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1176/2314] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:15.560769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.571489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11175a5-d0be-4a4a-aec8-9bfd03113756 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.576335 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.577200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.577485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.577769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] PATH_INFO: `/v3/projects/c4bf731fb59644a0bdc350b6801ba9b4/users/dfdbc8f00f7a45dc852f190cf49e9d96/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.593796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bf731fb59644a0bdc350b6801ba9b4, user_id=dfdbc8f00f7a45dc852f190cf49e9d96, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.596938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.610439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1139/2315] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:15 2022] PUT /identity/v3/projects/c4bf731fb59644a0bdc350b6801ba9b4/users/dfdbc8f00f7a45dc852f190cf49e9d96/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:15.627500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.628047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.628047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.658190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] MFA Rules not processed for user `dfdbc8f00f7a45dc852f190cf49e9d96`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:15.659443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:15.732641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1177/2316] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:15.750282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:15.752021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:15.822890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7155e-7e4a-40c3-a35e-faa45da45e7a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:15.827443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:15.828100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:15.828383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:15.828661 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:15.837538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:15.839016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23075-e5ff-4c88-b960-946bbaaa0bc7 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:15.848762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1140/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:17.791206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:17.792609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:17.956431 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522e44c-7bb1-4106-868c-c45f90a296e0 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:17.962320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:17.963269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:17.963559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:17.963965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] PATH_INFO: `/v3/users/7156a75fa0cd45bea9a6d256f4a7a669` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:17.965278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7156a75fa0cd45bea9a6d256f4a7a669)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:17.967389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:18.032005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7156a75fa0cd45bea9a6d256f4a7a669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.040341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7156a75fa0cd45bea9a6d256f4a7a669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.049000 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7156a75fa0cd45bea9a6d256f4a7a669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.049723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7156a75fa0cd45bea9a6d256f4a7a669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.050712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7156a75fa0cd45bea9a6d256f4a7a669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.069981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1178/2318] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:17 2022] DELETE /identity/v3/users/7156a75fa0cd45bea9a6d256f4a7a669 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:18.076063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:18.077124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:18.077654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:18.116419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:18.118239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:18.197593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1141/2319] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:18.207914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:18.209619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:18.317249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00b63d-f1a1-40c6-ba51-d68485648e4b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:18.320871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:18.321516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:18.321795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:18.322091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:18.332357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:18.333849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:18.343693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1179/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:18.615653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:18.617474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:18.634055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4247b-cc11-42f7-be8e-10bf9137bafa None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:18.640626 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:18.641498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:18.641804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:18.642032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] PATH_INFO: `/v3/projects/1a1d19ba25b54a51ba2bdbc9c0701dfd` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:18.643434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1d19ba25b54a51ba2bdbc9c0701dfd)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:18.646159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:18.701505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1d19ba25b54a51ba2bdbc9c0701dfd', 'request_id': 'req-18e9aefc-d98c-452d-abab-43af8831fa7b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.711475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1d19ba25b54a51ba2bdbc9c0701dfd', 'request_id': 'req-18e9aefc-d98c-452d-abab-43af8831fa7b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.723274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1d19ba25b54a51ba2bdbc9c0701dfd', 'request_id': 'req-18e9aefc-d98c-452d-abab-43af8831fa7b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.735165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] The token cache is being invalidate because project 1a1d19ba25b54a51ba2bdbc9c0701dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:18.735526 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.736177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-18e9aefc-d98c-452d-abab-43af8831fa7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:18.738157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1142/2321] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:18 2022] DELETE /identity/v3/projects/1a1d19ba25b54a51ba2bdbc9c0701dfd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:19.062607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:19.064109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.077555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2fd24-ab4e-4823-ba56-47cd8d91b374 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:19.134316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:19.135214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.135499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.135779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] PATH_INFO: `/v3/users/dfdbc8f00f7a45dc852f190cf49e9d96` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.136969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfdbc8f00f7a45dc852f190cf49e9d96)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:19.138975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:19.183295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfdbc8f00f7a45dc852f190cf49e9d96'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.189850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfdbc8f00f7a45dc852f190cf49e9d96'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.197593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfdbc8f00f7a45dc852f190cf49e9d96'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.198198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfdbc8f00f7a45dc852f190cf49e9d96'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.198824 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfdbc8f00f7a45dc852f190cf49e9d96'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.214967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1180/2322] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:19 2022] DELETE /identity/v3/users/dfdbc8f00f7a45dc852f190cf49e9d96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:19.219471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.219936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.220027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.236839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:19.238528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.295954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1143/2323] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:19.306122 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:19.307592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.364860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff29d1-c543-4359-851f-bea8ae902c40 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:19.369042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:19.369687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.369971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.370246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.380736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:19.382176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9673448-a620-4bf2-9c8b-9d7dfcdf9b31 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:19.392445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1181/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:19.746969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:19.748776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.761553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f57cf-dc47-42a0-a7b0-5127448da976 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:19.766845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:19.767722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.768004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.768278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] PATH_INFO: `/v3/projects/c4bf731fb59644a0bdc350b6801ba9b4` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.769565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bf731fb59644a0bdc350b6801ba9b4)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:19.771684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:19.823309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bf731fb59644a0bdc350b6801ba9b4', 'request_id': 'req-f57bf51c-316e-489a-82a1-07f5109be44b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.829569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bf731fb59644a0bdc350b6801ba9b4', 'request_id': 'req-f57bf51c-316e-489a-82a1-07f5109be44b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.837069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bf731fb59644a0bdc350b6801ba9b4', 'request_id': 'req-f57bf51c-316e-489a-82a1-07f5109be44b'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.846956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] The token cache is being invalidate because project c4bf731fb59644a0bdc350b6801ba9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:19.847770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.848391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f57bf51c-316e-489a-82a1-07f5109be44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:19.849935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1144/2325] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:19 2022] DELETE /identity/v3/projects/c4bf731fb59644a0bdc350b6801ba9b4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:19.854782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.855253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.855539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.892239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:19.893429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.950446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1182/2326] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:19.958782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:19.959083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:19.959365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:19.977725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:19.978964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:19.986906 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1145/2327] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:19.991031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.000790 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e4274-e6c1-4ab5-8c6e-c92082d449cd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.005344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.005988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.006272 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.006586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.007305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:58:20.007613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.009205 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.020834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1183/2328] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:58:20.024870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.033952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903c67-8d5a-4f7c-a14a-b0dd5961435e None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.038880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.039527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.039809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.040100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.040773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.042697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.072797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1146/2329] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:20.073925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.086267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a57580-5632-4586-8581-1eca068df53e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.142391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.143412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.143412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.143722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.144669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.146833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.167837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1184/2330] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:20.172196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.188646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880463-cca9-4634-bee5-1dd931fdfbc2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.193954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.194653 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.194937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.195214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.195936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.197571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.212036 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1147/2331] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:20.216230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.236013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47781dd7-a439-4800-84ac-cf354276f018 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.246083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.247646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.248188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.249118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.249949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.251631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f781c93-72aa-4790-b67d-0d5cfd1d08e3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.270399 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1185/2332] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:20.271593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.282078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321aaff9-c275-4043-b828-dea04d2634c0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.287757 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.288602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.288880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.289156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] PATH_INFO: `/v3/projects/11bf63dbe56244079b6e442134b9a05f/users/174e003184c14333b29bc2aa7b0bd71a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.304096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bf63dbe56244079b6e442134b9a05f, user_id=174e003184c14333b29bc2aa7b0bd71a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.306796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.319123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1148/2333] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:20 2022] PUT /identity/v3/projects/11bf63dbe56244079b6e442134b9a05f/users/174e003184c14333b29bc2aa7b0bd71a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:20.330424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.330771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.331053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.356828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] MFA Rules not processed for user `174e003184c14333b29bc2aa7b0bd71a`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:20.358039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:20.419968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1186/2334] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:20.424723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.484611 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072c61-4e8f-4eb3-bdde-3a7cb6c1f7bf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.490615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.491276 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.491559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.491833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.492522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.494435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.527916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1149/2335] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:20.531695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.545670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2be7-16c1-4d22-9d19-9d584a9f43d9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.611070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.611748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.612168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.612454 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.613788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.615804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.637050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1187/2336] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:20.641135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.652836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3fa6-8282-45d9-abea-bb06293d9660 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.664048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.664720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.665002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.665412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.666346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.668687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.684098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1150/2337] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:20.687224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.698162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3783e-ed7b-440c-b1c9-585c2b215831 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.703221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.704026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.704379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.704728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.705529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.707801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418fb9a-fed7-4ecb-9a46-c78af6fe3832 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.717827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1188/2338] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:20.721981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.732392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edfd50-d932-4c7b-b9dc-e59d230dafa0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.736891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.737773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.738056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.738329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] PATH_INFO: `/v3/projects/c8cd4143f8a54c1ea5855cf827970b06/users/8c2e8318de9a4c5096c93d6fb5a9f916/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.753608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cd4143f8a54c1ea5855cf827970b06, user_id=8c2e8318de9a4c5096c93d6fb5a9f916, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.756466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.770341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1151/2339] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:20 2022] PUT /identity/v3/projects/c8cd4143f8a54c1ea5855cf827970b06/users/8c2e8318de9a4c5096c93d6fb5a9f916/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:20.780448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.780807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.781159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.809679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] MFA Rules not processed for user `8c2e8318de9a4c5096c93d6fb5a9f916`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:20.811188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:20.875324 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1189/2340] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:20.879943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.942474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa040-80ab-4923-838f-1981ee9b3695 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:20.947169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:20.947823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:20.948106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:20.948383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:20.949086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:20.951031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:20.976404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1152/2341] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:58:20.980388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:20.990912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee6d4-f584-4096-b47a-4385510f0a31 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.046091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.046785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.047070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.047348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.048032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.049960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.069642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1190/2342] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:20 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:21.073433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:21.083964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99548-9157-4eef-bb7f-2d88bccf745c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.088619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.089270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.089555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.089834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.090599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.092196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.102751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1153/2343] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:21.106959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:21.116528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a3e2e-ff97-4a0d-8155-19054439ef73 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.121149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.122004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.122605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.122880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] PATH_INFO: `/v3/projects/0b3fd20e203c4b2e801e556003dc0d73/users/c5da20a3095d4bc39aaa4e783d6b6227/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.141048 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3fd20e203c4b2e801e556003dc0d73, user_id=c5da20a3095d4bc39aaa4e783d6b6227, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.143803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.156312 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1191/2344] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:21 2022] PUT /identity/v3/projects/0b3fd20e203c4b2e801e556003dc0d73/users/c5da20a3095d4bc39aaa4e783d6b6227/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:21.160435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:21.170136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08a830-3897-4a13-b17e-c9668d94a81e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.224755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.225414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.225699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.226001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.226753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.228353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db2569-d7e7-4255-bc1b-1d6593273212 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.237907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1154/2345] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:21.241977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:21.252718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e773-b71a-4010-81dc-a0b087b5a88d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.257914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.258825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.259114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.259394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] PATH_INFO: `/v3/projects/0b3fd20e203c4b2e801e556003dc0d73/users/c5da20a3095d4bc39aaa4e783d6b6227/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.261370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3fd20e203c4b2e801e556003dc0d73, user_id=c5da20a3095d4bc39aaa4e783d6b6227, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.264071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.274949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1192/2346] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:21 2022] PUT /identity/v3/projects/0b3fd20e203c4b2e801e556003dc0d73/users/c5da20a3095d4bc39aaa4e783d6b6227/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:21.286258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.287226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.287523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.315555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] MFA Rules not processed for user `c5da20a3095d4bc39aaa4e783d6b6227`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:21.317314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:21.384175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1155/2347] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:21.396025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:21.397758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:21.452656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e12061-93ff-448c-b0f3-5c8f32671bd7 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:21.456303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:21.457078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:21.457361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:21.457637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:21.513224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:21.514695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ea752-7364-42b0-b2a6-6d504b4269bc service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:21.523816 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1193/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:23.814763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:23.816224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:23.879804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707fe3c-c5a5-4e96-a206-a409477a6a94 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:23.884429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:23.885296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:23.885579 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:23.885856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] PATH_INFO: `/v3/users/65bb39380bc54627a858d0dde96c9c4a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:23.887085 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bb39380bc54627a858d0dde96c9c4a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:23.888997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:23.934923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bb39380bc54627a858d0dde96c9c4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:23.942737 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bb39380bc54627a858d0dde96c9c4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:23.943450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bb39380bc54627a858d0dde96c9c4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:23.955705 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bb39380bc54627a858d0dde96c9c4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:23.956920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bb39380bc54627a858d0dde96c9c4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:23.969075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1156/2349] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:23 2022] DELETE /identity/v3/users/65bb39380bc54627a858d0dde96c9c4a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:23.974070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:23.974549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:23.974640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:23.995051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:23.996403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.049493 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.050855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.056924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1194/2350] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:24.066694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.068025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.109629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605c3cb-8acb-4e28-9810-3f52c20bbcc6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.113496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.114147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.114425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.114728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.116512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.127799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05d9c-6db2-4b01-ab19-b12cbdd6a40c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.132119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.132774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.133063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.133341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.143069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.145091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.155084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1195/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:58:24.176847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.178285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5b836-2f02-445e-8282-2be81f834cb6 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.187251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1157/2352] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:58:24.450313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.451888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.468948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49fdf-fe0f-4a1e-ab50-7ff710305ae2 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.479637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.480582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.480874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.481157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] PATH_INFO: `/v3/projects/a4ea293f7e6f48d69e04cb1f4721f637` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.482420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ea293f7e6f48d69e04cb1f4721f637)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.484884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.541761 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ea293f7e6f48d69e04cb1f4721f637', 'request_id': 'req-a42141d6-ef9e-487c-84a6-5656c1aeb36d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:24.553723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ea293f7e6f48d69e04cb1f4721f637', 'request_id': 'req-a42141d6-ef9e-487c-84a6-5656c1aeb36d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:24.561677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ea293f7e6f48d69e04cb1f4721f637', 'request_id': 'req-a42141d6-ef9e-487c-84a6-5656c1aeb36d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:24.580039 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] The token cache is being invalidate because project a4ea293f7e6f48d69e04cb1f4721f637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:24.580453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:24.581165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a42141d6-ef9e-487c-84a6-5656c1aeb36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:24.583056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1196/2353] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:24 2022] DELETE /identity/v3/projects/a4ea293f7e6f48d69e04cb1f4721f637 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:24.587994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.588505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.588916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.609475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:24.611460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.676197 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1158/2354] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:24.684734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.685031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.685726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.703624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:24.704832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.713347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1197/2355] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:24.717718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.727891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd21bb-1731-4f70-8c7f-7af68bc28805 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.732844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.733501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.733790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.734065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.734817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:58:24.735133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.736731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.748772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1159/2356] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:58:24.753220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.762695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6bbb4-cc71-42d4-a426-f056127089f9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.767403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.768077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.768360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.768629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.769871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.771785 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.798558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.800290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.803502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1198/2357] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:24 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:24.806350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.857492 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fec7-d072-4b67-bb5e-e83261fb0b77 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.866147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda727-8c59-4ec9-9ad3-806449c23fbd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.871076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.871736 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.872015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.872548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.873232 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.875193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.900349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1199/2358] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:24 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:58:24.901381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.911030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.912087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.912087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.912469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.912589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b71a-58c7-4813-a7df-5a2a6648534d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.914639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:24.918119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.918808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.919092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.919378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.920099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.921703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.932735 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1200/2359] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:24.937110 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.948274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e38c93-835b-4a31-95ff-64e0430aa111 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.952855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.953500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.953789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.954070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.954821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.956991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.967949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1201/2360] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:58:24.971703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:24.981524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810e973-6457-4995-86d1-4392cbb889b3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:24.982165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:24.983638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dcd29-1c8b-466a-8cc9-27c30ea543da service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:24.986344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:24.987413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:24.988288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:24.988551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] PATH_INFO: `/v3/projects/df285cee66ef47e1a9dea260280f8147/users/f00a618c24844e538817d186972f974a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:24.994680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1160/2361] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 19:58:25.007277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df285cee66ef47e1a9dea260280f8147, user_id=f00a618c24844e538817d186972f974a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:25.009976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:25.022986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1202/2362] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:24 2022] PUT /identity/v3/projects/df285cee66ef47e1a9dea260280f8147/users/f00a618c24844e538817d186972f974a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:25.033780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:25.034142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:25.035050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:25.063089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] MFA Rules not processed for user `f00a618c24844e538817d186972f974a`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:25.064264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:25.128968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1161/2363] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:25.139631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:25.195730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b7030-b4f0-4b5d-a19b-80c6a3859b7b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:25.199632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:25.200274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:25.200560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:25.200846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:25.209765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:25.211241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beafeee-6482-4aab-aef8-ebb2a1e01cfa service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:25.219971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1203/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:30.921970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:30.923572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:31.000414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c531-7f31-42b0-bc33-d6aed33817be None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:31.010370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:31.011270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:31.011552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:31.011827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] PATH_INFO: `/v3/users/174e003184c14333b29bc2aa7b0bd71a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:31.013020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] RBAC: Authorizing `identity:delete_user(user_id=174e003184c14333b29bc2aa7b0bd71a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:31.014981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:31.062558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174e003184c14333b29bc2aa7b0bd71a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:31.072285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174e003184c14333b29bc2aa7b0bd71a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:31.072285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174e003184c14333b29bc2aa7b0bd71a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:31.088164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174e003184c14333b29bc2aa7b0bd71a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:31.089040 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174e003184c14333b29bc2aa7b0bd71a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:31.104062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1162/2365] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:30 2022] DELETE /identity/v3/users/174e003184c14333b29bc2aa7b0bd71a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:31.108715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:31.109212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:31.109390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:31.128943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:31.130333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:31.200474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1204/2366] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:31.211174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:31.212686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:31.271676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8e25-58af-4473-a3d3-6b7ee364200e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:31.275348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:31.275987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:31.276267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:31.276541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:31.286577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:31.288010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4ee85-22bd-4a78-afe2-3b3cae7fc8fe service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:31.297837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1163/2367] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:31.938260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:31.940387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:31.954423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1ad1a-7132-44f5-b5ad-102bee60cf5c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:31.959896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:31.960387 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:31.960671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:31.960944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] PATH_INFO: `/v3/projects/11bf63dbe56244079b6e442134b9a05f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:31.962306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bf63dbe56244079b6e442134b9a05f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:31.964427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:31.999724 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:32.000246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:32.000246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:32.018872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] MFA Rules not processed for user `b642ac529ee043fd894a9188f30ed026`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:32.020166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:32.021401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bf63dbe56244079b6e442134b9a05f', 'request_id': 'req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.027894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bf63dbe56244079b6e442134b9a05f', 'request_id': 'req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.033377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bf63dbe56244079b6e442134b9a05f', 'request_id': 'req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.045724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] The token cache is being invalidate because project 11bf63dbe56244079b6e442134b9a05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:32.046015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.046666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.048211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1205/2368] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:31 2022] DELETE /identity/v3/projects/11bf63dbe56244079b6e442134b9a05f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:32.052639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:32.054046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:32.078715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1164/2369] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:32.117896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caa1ea-3b3e-4942-863b-6c2ebea4a7fb admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:32.122857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:32.123729 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:32.124013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:32.124602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] PATH_INFO: `/v3/users/8c2e8318de9a4c5096c93d6fb5a9f916` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:32.126031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e8318de9a4c5096c93d6fb5a9f916)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:32.129198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:32.178788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e8318de9a4c5096c93d6fb5a9f916'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.185515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e8318de9a4c5096c93d6fb5a9f916'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.194007 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e8318de9a4c5096c93d6fb5a9f916'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.194866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e8318de9a4c5096c93d6fb5a9f916'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.198873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e8318de9a4c5096c93d6fb5a9f916'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.217863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1206/2370] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:32 2022] DELETE /identity/v3/users/8c2e8318de9a4c5096c93d6fb5a9f916 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:32.489979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:32.501021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a72a8-44ed-4fe0-8451-d1571cee4400 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:32.563181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:32.563951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:32.564238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:32.564518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] PATH_INFO: `/v3/projects/c8cd4143f8a54c1ea5855cf827970b06` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:32.566268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cd4143f8a54c1ea5855cf827970b06)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:32.568222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:32.614246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cd4143f8a54c1ea5855cf827970b06', 'request_id': 'req-a8378d54-2e21-47af-80fd-2509deac04a7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.620447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cd4143f8a54c1ea5855cf827970b06', 'request_id': 'req-a8378d54-2e21-47af-80fd-2509deac04a7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.628985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cd4143f8a54c1ea5855cf827970b06', 'request_id': 'req-a8378d54-2e21-47af-80fd-2509deac04a7'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.639599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] The token cache is being invalidate because project c8cd4143f8a54c1ea5855cf827970b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:32.639884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.640558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.642231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1165/2371] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:32 2022] DELETE /identity/v3/projects/c8cd4143f8a54c1ea5855cf827970b06 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:32.646891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:32.648421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:32.662846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f0e9b-9f46-4674-8190-8becae8f8d4c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:32.726014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:32.727035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:32.727396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:32.727747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] PATH_INFO: `/v3/users/c5da20a3095d4bc39aaa4e783d6b6227` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:32.729062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5da20a3095d4bc39aaa4e783d6b6227)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:32.732626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:32.785638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5da20a3095d4bc39aaa4e783d6b6227'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.793109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5da20a3095d4bc39aaa4e783d6b6227'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.801437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5da20a3095d4bc39aaa4e783d6b6227'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.802567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5da20a3095d4bc39aaa4e783d6b6227'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.803286 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5da20a3095d4bc39aaa4e783d6b6227'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:32.823468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1207/2372] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:32 2022] DELETE /identity/v3/users/c5da20a3095d4bc39aaa4e783d6b6227 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:33.093228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:33.094833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:33.108166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378d54-2e21-47af-80fd-2509deac04a7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:33.165930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:33.166808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:33.167090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:33.167363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] PATH_INFO: `/v3/projects/0b3fd20e203c4b2e801e556003dc0d73` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:33.168538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3fd20e203c4b2e801e556003dc0d73)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:33.170438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:33.215827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3fd20e203c4b2e801e556003dc0d73', 'request_id': 'req-19b77ffe-8bb5-453e-8482-e46b785c6c75'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:33.221740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3fd20e203c4b2e801e556003dc0d73', 'request_id': 'req-19b77ffe-8bb5-453e-8482-e46b785c6c75'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:33.229019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3fd20e203c4b2e801e556003dc0d73', 'request_id': 'req-19b77ffe-8bb5-453e-8482-e46b785c6c75'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:33.238892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] The token cache is being invalidate because project 0b3fd20e203c4b2e801e556003dc0d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:33.239177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:33.239806 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-19b77ffe-8bb5-453e-8482-e46b785c6c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:33.241352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1166/2373] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:33 2022] DELETE /identity/v3/projects/0b3fd20e203c4b2e801e556003dc0d73 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:35.379137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:35.380823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:35.398941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187f08-e4f6-4524-83b9-8cdda2cb34e3 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:35.468217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:35.469192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:35.469389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:35.469665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] PATH_INFO: `/v3/users/9bd4a057a03b4c8db5866209b9fb4097` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:35.470929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd4a057a03b4c8db5866209b9fb4097)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:35.472933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:35.521721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd4a057a03b4c8db5866209b9fb4097'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:35.529606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd4a057a03b4c8db5866209b9fb4097'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:35.537033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd4a057a03b4c8db5866209b9fb4097'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:35.537715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd4a057a03b4c8db5866209b9fb4097'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:35.538411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd4a057a03b4c8db5866209b9fb4097'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:35.555302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1208/2374] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:35 2022] DELETE /identity/v3/users/9bd4a057a03b4c8db5866209b9fb4097 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:35.560110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:35.561002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:35.561389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:35.585259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:35.586780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:35.656524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1167/2375] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:35.666229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:35.667808 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:35.729985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b7a0-b1a2-4f5f-a19c-cccfa6f18220 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:35.734056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:35.734613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:35.734898 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:35.735178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:35.745948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:35.748352 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:35.759624 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1209/2376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:36.117796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:36.119610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:36.137041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519fd55-bcb9-4285-8c6b-47c5d695dbed None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:36.146151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:36.147064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:36.147553 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:36.148019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] PATH_INFO: `/v3/projects/bf5be273f26747ce865579f6d7c3ef41` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:36.152990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5be273f26747ce865579f6d7c3ef41)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:36.155283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:36.209923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5be273f26747ce865579f6d7c3ef41', 'request_id': 'req-766ba933-3ed1-46e0-8bab-7e59c3a0d387'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:36.216126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5be273f26747ce865579f6d7c3ef41', 'request_id': 'req-766ba933-3ed1-46e0-8bab-7e59c3a0d387'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:36.224363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5be273f26747ce865579f6d7c3ef41', 'request_id': 'req-766ba933-3ed1-46e0-8bab-7e59c3a0d387'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:36.234617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] The token cache is being invalidate because project bf5be273f26747ce865579f6d7c3ef41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:36.234919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:36.235524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-766ba933-3ed1-46e0-8bab-7e59c3a0d387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:36.237084 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1168/2377] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:36 2022] DELETE /identity/v3/projects/bf5be273f26747ce865579f6d7c3ef41 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:44.416746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:44.418164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:44.430891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1870ef-434e-446e-9a05-a1465d34ae20 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:44.484341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:44.485197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:44.485479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:44.485752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] PATH_INFO: `/v3/users/f00a618c24844e538817d186972f974a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:44.487018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00a618c24844e538817d186972f974a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:44.488941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:44.538040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00a618c24844e538817d186972f974a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:44.544647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00a618c24844e538817d186972f974a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:44.552833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00a618c24844e538817d186972f974a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:44.553507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00a618c24844e538817d186972f974a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:44.554275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00a618c24844e538817d186972f974a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:44.571718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1210/2378] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 19:58:44 2022] DELETE /identity/v3/users/f00a618c24844e538817d186972f974a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:44.576237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:44.576713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:44.576811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:44.595117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:44.596302 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:44.653696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1169/2379] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:44.663445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:44.664846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:44.721803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf5775-55f5-41bd-97aa-e3d543a8bc77 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:44.725550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:44.726194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:44.726502 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:44.726782 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:44.736101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:44.738113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701f5b-b980-4094-b296-12ec17ade0d7 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:44.748474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1211/2380] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:45.009340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.010325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:45.023935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e3a6-1d1a-4074-b771-ae8b0d4ec373 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.028720 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.029581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.029861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.030136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] PATH_INFO: `/v3/projects/df285cee66ef47e1a9dea260280f8147` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.031610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df285cee66ef47e1a9dea260280f8147)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.034056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.085606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df285cee66ef47e1a9dea260280f8147', 'request_id': 'req-f7938fde-a9a2-4df6-b38a-509f44bccd4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:45.092407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df285cee66ef47e1a9dea260280f8147', 'request_id': 'req-f7938fde-a9a2-4df6-b38a-509f44bccd4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:45.100076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df285cee66ef47e1a9dea260280f8147', 'request_id': 'req-f7938fde-a9a2-4df6-b38a-509f44bccd4a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:45.110366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] The token cache is being invalidate because project df285cee66ef47e1a9dea260280f8147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 19:58:45.110709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:45.111373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7938fde-a9a2-4df6-b38a-509f44bccd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 19:58:45.113431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1170/2381] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 19:58:45 2022] DELETE /identity/v3/projects/df285cee66ef47e1a9dea260280f8147 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:45.118485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.118787 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.119067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.146091 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:45.147321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:45.203531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1212/2382] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 19:58:45.211325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.211638 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.211915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.230348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:45.231567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:45.239988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1171/2383] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:45.243935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.254158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a480-8c9c-498f-b01f-4ed9673ef553 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.258890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.259539 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.259826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.260132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.261166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 19:58:45.261483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.263119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.274394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1213/2384] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 19:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 19:58:45.278575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.288277 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406572-e622-4c5e-b475-23fb690e1501 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.293190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.293832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.294118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.294687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.295497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.297393 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.329772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1172/2385] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:45 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:45.331281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.341500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e2f9a-b986-4a75-8182-4b0969d419fa admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.398222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.398917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.399203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.399479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.400173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.402104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.421605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1214/2386] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:45 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:58:45.425622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.435589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5b99c-ba91-4a08-8064-72a548f45bbf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.440121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.440786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.441125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.441403 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.442115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.443729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.453778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1173/2387] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:45.458141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.467977 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6198-5313-49e3-a223-5246450d1e0d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.473263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.473926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.474213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.474519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.475267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.476868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feafcd-442b-4ed5-a7a7-e9627e9e12c4 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.486923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1215/2388] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:45.491064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.501093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5179-2d0b-44c3-acc9-df32b479c5a0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.505614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.506510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.506799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.507077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] PATH_INFO: `/v3/projects/493768250fbb449a8b5430992e76b60f/users/be0ebfb74d254359b4dfa36d9aff4ac6/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.521795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493768250fbb449a8b5430992e76b60f, user_id=be0ebfb74d254359b4dfa36d9aff4ac6, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.524478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.539217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1174/2389] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:45 2022] PUT /identity/v3/projects/493768250fbb449a8b5430992e76b60f/users/be0ebfb74d254359b4dfa36d9aff4ac6/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:45.545064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4289-1110-43e8-b28b-ba09868f49c4 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.545360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4289-1110-43e8-b28b-ba09868f49c4 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.545707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4289-1110-43e8-b28b-ba09868f49c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.563606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4dde4289-1110-43e8-b28b-ba09868f49c4 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:45.564979 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4dde4289-1110-43e8-b28b-ba09868f49c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:45.625184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1216/2390] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:45.634568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:45.636355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:45.691912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b4766-a7ac-4341-bf67-21d5b8ccb743 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:45.695623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:45.696273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:45.696632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:45.696839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:45.707003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:45.708381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8c0f-5d81-458e-95a0-8c44e8526fc7 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:45.717666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1175/2391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:58:49.067505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:49.067947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:49.067947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:49.092012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] MFA Rules not processed for user `2751fce03c284a91b152f545bd8c63ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:49.093610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:49.185124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1217/2392] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:51.811576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:51.812151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:51.812622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:51.849058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] MFA Rules not processed for user `be0ebfb74d254359b4dfa36d9aff4ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:51.850761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:51.914996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1176/2393] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:51.919405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:51.931452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe237-5223-47d1-8767-820346b5388f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:51.936255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:51.936911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:51.937213 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:51.937484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:51.938188 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:51.940182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:51.964470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1218/2394] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 19:58:51 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 19:58:51.968099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:51.980417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2041bb-6e22-4efb-8237-cb02b838765a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:52.037434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:52.038109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:52.038679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:52.038955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:52.039670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:52.041612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:52.062560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1177/2395] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 19:58:51 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 19:58:52.065553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:52.077070 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaafbc7-78ec-4d19-989b-ec43a23f9533 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:52.082326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:52.083168 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:52.083521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:52.083878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:52.084672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:52.086397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:52.098902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1219/2396] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 19:58:52.103018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:52.114365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b769-5974-4ce3-895d-39c053208511 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:52.119438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:52.120357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:52.120637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:52.120915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] PATH_INFO: `/v3/projects/5520708b8da040dab5b2b76a4dd222a1/users/13b28ec4aa4542e2831ad79eae765d2d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:52.139871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5520708b8da040dab5b2b76a4dd222a1, user_id=13b28ec4aa4542e2831ad79eae765d2d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:52.143160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:52.156581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1178/2397] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:52 2022] PUT /identity/v3/projects/5520708b8da040dab5b2b76a4dd222a1/users/13b28ec4aa4542e2831ad79eae765d2d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 19:58:52.161165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:52.171577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a98a95-9a0f-471d-9699-94e35294f465 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:52.248582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:52.249493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:52.249992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:52.250638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:52.251584 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:52.253421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d61c31-612d-46e9-abff-5e55bd0fc3f8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:52.268170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1220/2398] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 19:58:52.269509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:52.282491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912d3fa-624e-4131-a926-eb8e46d464a1 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:52.288236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:52.289144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:52.289421 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:52.289689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] PATH_INFO: `/v3/projects/5520708b8da040dab5b2b76a4dd222a1/users/13b28ec4aa4542e2831ad79eae765d2d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:52.292519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5520708b8da040dab5b2b76a4dd222a1, user_id=13b28ec4aa4542e2831ad79eae765d2d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:52.295578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:52.307482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1179/2399] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 19:58:52 2022] PUT /identity/v3/projects/5520708b8da040dab5b2b76a4dd222a1/users/13b28ec4aa4542e2831ad79eae765d2d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 19:58:57.992052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:57.992526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:57.992802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:58.023217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] MFA Rules not processed for user `13b28ec4aa4542e2831ad79eae765d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:58:58.024440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:58.102429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1221/2400] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:58:58.116267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:58:58.118211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:58:58.224776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2bf2-455b-412e-af5c-be9029c4bae2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:58:58.230446 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:58:58.231118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:58:58.231397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:58:58.231670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:58:58.294645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:58:58.296280 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ad353-c890-49b2-8e90-a7121b5cce3a service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:58:58.308959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1180/2401] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:59:11.346240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:59:11.347681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:59:11.435676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc626bca-da88-4d8d-bc51-b9b7ebe97276 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:59:11.440706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:59:11.441345 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:59:11.441629 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:59:11.441905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:59:11.443645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:59:11.455344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:59:11.457306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:59:11.466980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1222/2402] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:59:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 19:59:15.598410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed1ae-3423-4f7c-80df-c3801b4b26c7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:59:15.598988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed1ae-3423-4f7c-80df-c3801b4b26c7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:59:15.598988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ed1ae-3423-4f7c-80df-c3801b4b26c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:59:15.615602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-852ed1ae-3423-4f7c-80df-c3801b4b26c7 None None] MFA Rules not processed for user `be0ebfb74d254359b4dfa36d9aff4ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 19:59:15.616795 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-852ed1ae-3423-4f7c-80df-c3801b4b26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:59:15.623950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1181/2403] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 19:59:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 19:59:32.804906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 19:59:32.806770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 19:59:32.860031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b11a05-aa74-4c7f-b477-08ecd53c9c0a service placement] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 19:59:32.864238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 19:59:32.865150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 19:59:32.865436 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 19:59:32.865710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 19:59:32.874946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 19:59:32.876365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b740f-d265-46c7-8be4-fb2d3ea17c0e service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 19:59:32.886302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1223/2404] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 19:59:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:00:00.276576 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace77e2-c4eb-4649-815c-7965ee6e810e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:00:00.277133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace77e2-c4eb-4649-815c-7965ee6e810e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:00:00.277133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace77e2-c4eb-4649-815c-7965ee6e810e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:00:00.294967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3ace77e2-c4eb-4649-815c-7965ee6e810e None None] MFA Rules not processed for user `b642ac529ee043fd894a9188f30ed026`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:00:00.296161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3ace77e2-c4eb-4649-815c-7965ee6e810e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:00:00.351716 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1182/2405] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:00:03.028885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:00:03.029344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:00:03.029453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:00:03.048600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] MFA Rules not processed for user `2751fce03c284a91b152f545bd8c63ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:00:03.049945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:00:03.104986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1224/2406] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:00:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:00:54.117774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:00:54.118322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:00:54.118322 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:00:54.136804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] MFA Rules not processed for user `0b7dead8216e4cd59eaa15ad8842e38a`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:00:54.138041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:00:54.194911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1183/2407] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:00:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:09.430001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:09.441044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b97c-e285-4dc3-b9ca-d67beedf8db6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:09.444815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:09.445551 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:09.446044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:09.446397 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:09.448391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:09.523014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:09.524948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:09.536303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1225/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:11.849900 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:11.860877 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6510fc2-9742-4f94-a179-54118728c050 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:11.865133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:11.865789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:11.866076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:11.866356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:11.868341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:11.884869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:11.886323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:11.905386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1184/2409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:01:13.176891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:13.178565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:13.211647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d41db-dc9f-4ae0-a0f6-1340c8d0b32d service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:13.217687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:13.218661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:13.218947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:13.219223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] PATH_INFO: `/v3/users/b642ac529ee043fd894a9188f30ed026` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:13.220477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b642ac529ee043fd894a9188f30ed026)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:13.222424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:13.269279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:13.282534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016345e-7fde-4735-91d4-8121156d6a96 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:13.311799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:13.312466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:13.313391 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:13.313826 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:13.316457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:13.321627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b642ac529ee043fd894a9188f30ed026'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.330798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b642ac529ee043fd894a9188f30ed026'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.340960 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:13.342620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:13.343959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b642ac529ee043fd894a9188f30ed026'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.344908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b642ac529ee043fd894a9188f30ed026'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.346022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-75aaf464-6d0d-4564-8234-59f6e8a6c502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b642ac529ee043fd894a9188f30ed026'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.365543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1185/2410] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:13.379075 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1226/2411] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:01:13 2022] DELETE /identity/v3/users/b642ac529ee043fd894a9188f30ed026 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:01:13.666594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:13.683598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ad210-d60a-49cb-bdff-a684474b6b73 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:13.745186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:13.746133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:13.746413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:13.746779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] PATH_INFO: `/v3/projects/866e5dd5364e4bd980ba03f1b76aac9d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:13.747974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866e5dd5364e4bd980ba03f1b76aac9d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:13.750111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:13.796102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866e5dd5364e4bd980ba03f1b76aac9d', 'request_id': 'req-b319d747-664d-4219-8097-a354e5534693'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.803035 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866e5dd5364e4bd980ba03f1b76aac9d', 'request_id': 'req-b319d747-664d-4219-8097-a354e5534693'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.810888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866e5dd5364e4bd980ba03f1b76aac9d', 'request_id': 'req-b319d747-664d-4219-8097-a354e5534693'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.821180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] The token cache is being invalidate because project 866e5dd5364e4bd980ba03f1b76aac9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:01:13.821603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.822239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b319d747-664d-4219-8097-a354e5534693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:01:13.823844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1186/2412] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:01:13 2022] DELETE /identity/v3/projects/866e5dd5364e4bd980ba03f1b76aac9d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:01:13.828915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:13.829208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:13.829608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:13.851843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:13.854132 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:13.925164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1227/2413] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:13.933069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:13.933754 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:13.934326 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:13.960838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:13.962657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:13.980531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1187/2414] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:13.981420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:13.995133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecee37-4844-4f57-8ffe-91738c20116e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.001151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.001867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.002157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.002495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.003249 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:01:14.003563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.005204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.021456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1228/2415] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:01:14.022730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.033797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19ca0a-18ea-4271-9c39-07d67091e048 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.039885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.040808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.041269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.041721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.042678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.044797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.083920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1188/2416] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:01:14 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:01:14.085206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.097192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc2f2-52d7-405d-a66a-9f5ece621552 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.163116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.163772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.164057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.164336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.165031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.167265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.190494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1229/2417] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:01:14 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:01:14.192272 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.202898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9db4-4acd-40d7-b979-2d54a090f807 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.208643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.209312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.209596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.210022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.210839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.212451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.224255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1189/2418] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:01:14.228204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.238807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a379a-a2e4-47e6-944b-f7e6fa26af04 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.243975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.244647 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.244931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.245252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.245934 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.248177 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec060d4-0228-4054-aa03-b09896c69c41 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.262909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1230/2419] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:01:14.264181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.275049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1454909-d76a-4ba4-893c-7976fce4da8d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.279812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.280712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.280989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.281265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] PATH_INFO: `/v3/projects/3f7d501f555c4a0ba2419f68ba756db7/users/56653f5922984dde83b35ba154e97bd0/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.298219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7d501f555c4a0ba2419f68ba756db7, user_id=56653f5922984dde83b35ba154e97bd0, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.300980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.314748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1190/2420] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:01:14 2022] PUT /identity/v3/projects/3f7d501f555c4a0ba2419f68ba756db7/users/56653f5922984dde83b35ba154e97bd0/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:01:14.319818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c74b9-45f9-4e33-b665-1ac645cf120e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.320112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c74b9-45f9-4e33-b665-1ac645cf120e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.320389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c74b9-45f9-4e33-b665-1ac645cf120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.339194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d54c74b9-45f9-4e33-b665-1ac645cf120e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:14.340396 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d54c74b9-45f9-4e33-b665-1ac645cf120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:14.399239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1231/2421] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:01:14.409340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:14.411051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:14.483079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc61ab-e2ac-47d9-a2b4-9d8752576e6a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:14.491584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:14.492373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:14.492722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:14.493096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:14.504184 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:14.506327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:14.520883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1191/2422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:16.670506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:16.671447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:16.671732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:16.693998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] MFA Rules not processed for user `2751fce03c284a91b152f545bd8c63ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:16.695305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:16.761114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1232/2423] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:17.354966 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:17.365738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466434ff-5f9c-489e-b10a-61b69b16db06 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:17.370330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:17.371275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:17.371727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:17.372370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:17.374649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:17.388130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:17.390328 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9c02-75e6-46bc-9566-518a0b0e72d0 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:17.400779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1192/2424] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:17.868453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:17.870591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:17.985852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629beee3-a2bd-4ddc-a73b-abeda5271dc6 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:17.991200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:17.991822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:17.992113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:17.992391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:17.994484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:18.006354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:18.007970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:18.018499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1233/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:19.383253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0036-e51e-49ec-bf74-5125f60b4376 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:19.384125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0036-e51e-49ec-bf74-5125f60b4376 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:19.385207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0036-e51e-49ec-bf74-5125f60b4376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:19.420375 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-f35c0036-e51e-49ec-bf74-5125f60b4376 None None] MFA Rules not processed for user `56653f5922984dde83b35ba154e97bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:19.423178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f35c0036-e51e-49ec-bf74-5125f60b4376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:19.542292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1193/2426] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:19.543255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:19.545005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:19.632809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e891-cd86-4039-8b06-612ff376f2d9 service placement] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:19.638825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:19.639488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:19.639955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:19.640392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:19.650175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:19.652935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:19.678755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1234/2427] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:21.108787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:21.109268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:21.109367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:21.134094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] MFA Rules not processed for user `56653f5922984dde83b35ba154e97bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:21.136496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:21.153164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1194/2428] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:22.607961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:22.609749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:22.628113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c814cc8-3d42-4798-96ff-9153bef2788a service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:22.633766 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:22.634416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:22.634725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:22.635003 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:22.636767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:22.648018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:22.649889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e1a61-aa9c-43b9-9791-64f1eb6d29e2 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:22.659429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1235/2429] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:28.681130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:28.691288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eba97-fd14-41d6-bcbe-20f0614d30c5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:28.696441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:28.697090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:28.697371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:28.697645 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:28.699443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:28.709590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:28.711166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:28.718967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1195/2430] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:42.752076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:42.752586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:42.752683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:42.771036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] MFA Rules not processed for user `be0ebfb74d254359b4dfa36d9aff4ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:01:42.772369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:42.830722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1236/2431] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:01:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:01:43.141536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:43.143240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:43.153424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d015a-5d46-455a-98f1-3758d61609bb service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:43.157017 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:43.157637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:43.157918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:43.158193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:43.160426 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:43.169405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:43.170908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:43.179701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1196/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:01:45.166684 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:45.182559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a4123-fceb-4aae-be61-33d2ae1328b3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:45.191793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:45.192649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:45.192959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:45.193251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:45.195140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:45.263623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:45.265248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:45.276411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1237/2433] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:46.093560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:46.111442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc0137-7719-4a98-872c-47c53ba125a3 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:46.119664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:46.120330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:46.120746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:46.121027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:46.122904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:46.136990 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:46.138629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:46.153394 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1197/2434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:01:58.382051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:01:58.394658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb9c18-2f7f-4a03-b265-1a85d87369cd service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:01:58.400363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:01:58.401012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:01:58.401300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:01:58.401583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:01:58.403374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:01:58.415566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:01:58.417154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:01:58.428561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1238/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:14.752882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:14.762007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9753-733e-43ea-9ff8-53fe12871673 service nova] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:14.765632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:14.766257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:14.766574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:14.766855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:14.768584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:14.780648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:14.782062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:14.792155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1198/2436] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:17.908499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:17.910533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:17.929993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5759-6e82-447b-a3e0-71a27b3131f7 service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:17.934664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:17.935546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:17.935831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:17.936102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] PATH_INFO: `/v3/users/0b7dead8216e4cd59eaa15ad8842e38a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:17.937353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7dead8216e4cd59eaa15ad8842e38a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:17.939349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:17.993608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7dead8216e4cd59eaa15ad8842e38a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.000274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7dead8216e4cd59eaa15ad8842e38a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.008195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7dead8216e4cd59eaa15ad8842e38a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.008810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7dead8216e4cd59eaa15ad8842e38a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.009434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3c0e0098-aaef-448b-bf2f-059a2a497a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7dead8216e4cd59eaa15ad8842e38a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.026527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1239/2437] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:17 2022] DELETE /identity/v3/users/0b7dead8216e4cd59eaa15ad8842e38a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:18.438345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.449537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b1f11-2092-4b0e-8d1d-28effa1ba6a5 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.504517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.505908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.506164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.506438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] PATH_INFO: `/v3/projects/bfb1f4857a6e438e87e546dfd1d8a8b9` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.507694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb1f4857a6e438e87e546dfd1d8a8b9)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.509584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.554559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'request_id': 'req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.560504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'request_id': 'req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.567317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb1f4857a6e438e87e546dfd1d8a8b9', 'request_id': 'req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.577845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] The token cache is being invalidate because project bfb1f4857a6e438e87e546dfd1d8a8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:18.578133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.578779 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dbc9cbb-ad0c-4b2e-8acb-bff535696ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:18.580304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1199/2438] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:18 2022] DELETE /identity/v3/projects/bfb1f4857a6e438e87e546dfd1d8a8b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:18.585487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34e89-5797-4b57-a431-50138263435f None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.585722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34e89-5797-4b57-a431-50138263435f None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.586005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34e89-5797-4b57-a431-50138263435f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.603335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f7b34e89-5797-4b57-a431-50138263435f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:18.604575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f7b34e89-5797-4b57-a431-50138263435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:18.661452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1240/2439] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:18.669271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af570b-396f-4a7e-9919-42922060beca None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.669562 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af570b-396f-4a7e-9919-42922060beca None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.669844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af570b-396f-4a7e-9919-42922060beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.688094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-10af570b-396f-4a7e-9919-42922060beca None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:18.689287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-10af570b-396f-4a7e-9919-42922060beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:18.697743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1200/2440] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:18.701772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b34e89-5797-4b57-a431-50138263435f None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.711350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b34e89-5797-4b57-a431-50138263435f None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.715915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.716554 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.716836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.717111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.717822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:18.718126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.719749 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.730851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1241/2441] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:02:18.735013 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af570b-396f-4a7e-9919-42922060beca None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.744746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af570b-396f-4a7e-9919-42922060beca None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.749363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.750001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.750283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.750603 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.751297 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.753183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.778987 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1201/2442] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:18 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:18.782953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.792670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba66a0-bed2-4c77-87a6-b3efa5028232 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.849042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.850001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.850542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.850923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.851642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.853925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.875173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1242/2443] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:18 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:18.879108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.889646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9dafd-a770-401d-bdcf-90e2e42af2f0 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.894480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.895236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.895527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.895802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.896558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.898145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.908841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1202/2444] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:18.913558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.923494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d10c0-6412-4505-8923-02675dccddce admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.928767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.929430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.929713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.929989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.930737 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.932338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cab5d0-8cda-4552-9110-850f054c4ad1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.945365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1243/2445] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:18.949715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:18.960076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c39-3315-40d0-88de-cbcde5f76418 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:18.964755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:18.965628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:18.965914 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:18.966187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] PATH_INFO: `/v3/projects/ee87f2655ab14499aebd1b4f9643336b/users/184a4c11c99840bab5326378ac24b221/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:18.981912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee87f2655ab14499aebd1b4f9643336b, user_id=184a4c11c99840bab5326378ac24b221, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:18.984713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:18.999358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1203/2446] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:18 2022] PUT /identity/v3/projects/ee87f2655ab14499aebd1b4f9643336b/users/184a4c11c99840bab5326378ac24b221/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:19.010011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.010326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.010689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.039473 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] MFA Rules not processed for user `184a4c11c99840bab5326378ac24b221`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:19.040859 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:19.106482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1244/2447] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:19.110938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.175838 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082e6c-f82d-458a-b45e-3613acac0197 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.180979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.181635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.181921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.182194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.182929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.184830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.212522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1204/2448] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:19 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:19.216051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.226851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455be03-15e3-4b76-976c-f56d2e6bc59e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.281637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.282305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.282631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.282911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.283627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.285552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.305744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1245/2449] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:19 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:19.309718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.320286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47158-3c07-4f26-96a8-b9a71c1b1db1 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.324977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.325621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.325901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.326176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.326928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.328502 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.338700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1205/2450] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:19.342830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.352713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9744e-f3f8-460a-a229-9d367d1c1b5e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.360989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.361847 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.362134 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.362413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] PATH_INFO: `/v3/projects/21e895297d4a406dbb9277d9267c3690/users/6562ad0e347f4f749f04f871523834f6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.380970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e895297d4a406dbb9277d9267c3690, user_id=6562ad0e347f4f749f04f871523834f6, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.383931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.398163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1246/2451] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:19 2022] PUT /identity/v3/projects/21e895297d4a406dbb9277d9267c3690/users/6562ad0e347f4f749f04f871523834f6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:19.402380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.412890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29d9e-506b-4c40-a6ee-fce39f5c4edf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.468477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.469086 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.469344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.469622 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.470342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.471964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8a1c9-1610-4412-a4c9-523f44fbdf5a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.481664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1206/2452] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:19.486065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.497405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0e8-d593-47dc-9a32-b76aa23389e8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.502089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.502997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.503283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.503559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] PATH_INFO: `/v3/projects/21e895297d4a406dbb9277d9267c3690/users/6562ad0e347f4f749f04f871523834f6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.506196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e895297d4a406dbb9277d9267c3690, user_id=6562ad0e347f4f749f04f871523834f6, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.508923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.518795 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1247/2453] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:19 2022] PUT /identity/v3/projects/21e895297d4a406dbb9277d9267c3690/users/6562ad0e347f4f749f04f871523834f6/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:19.530037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.530332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.530648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.556483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] MFA Rules not processed for user `6562ad0e347f4f749f04f871523834f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:19.557688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:19.623715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1207/2454] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:19.634917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.636630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:19.712086 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d87e-ff33-4a5f-a253-cd4dc44b77e2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.716215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.716854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.717138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.717424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.730669 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.732128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572e5d8-9b5d-4d3d-8cbe-2708442c36a9 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.744477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1248/2455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:19.816546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:19.828497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da59c-d287-4cbd-b3e1-3eb1bae8fac6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:19.832133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:19.832777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:19.833060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:19.833337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:19.888207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:19.889569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:19.898485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1208/2456] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:27.048102 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:27.048559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:27.048649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:27.107071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:27.108281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:27.183703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1249/2457] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:27.234672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:27.236747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:27.348441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb03c8-628a-4cfe-b9c2-8432f3d838a5 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:27.367338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:27.368028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:27.368321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:27.368602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:27.383458 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:27.385268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c4b3b-a2e9-43c1-a5cc-6f8f78e85d83 service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:27.405843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1209/2458] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:02:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:02:30.230495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:30.403317 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d7e6-df3a-45f6-97d1-246894bf719b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:30.416074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:30.417530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:30.417976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:30.418359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] PATH_INFO: `/v3/users/184a4c11c99840bab5326378ac24b221` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:30.420411 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184a4c11c99840bab5326378ac24b221)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:30.427891 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:30.562609 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184a4c11c99840bab5326378ac24b221'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:30.571346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184a4c11c99840bab5326378ac24b221'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:30.583741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184a4c11c99840bab5326378ac24b221'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:30.584856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184a4c11c99840bab5326378ac24b221'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:30.585807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184a4c11c99840bab5326378ac24b221'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:30.614960 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1250/2459] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:30 2022] DELETE /identity/v3/users/184a4c11c99840bab5326378ac24b221 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:30.620572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:30.621112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:30.621275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:30.643922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:30.648758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:30.731410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1210/2460] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:30.741683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:30.743403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:30.831240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795dfc5-8d32-4b7d-9cb9-4612cb9adbe6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:30.838945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:30.839623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:30.839912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:30.840472 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:30.852109 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:30.853589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:30.888943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1251/2461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:31.473627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:31.475387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:31.498857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e1f8c-2b69-4666-bb3d-96fcb02b78f0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:31.506450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:31.507669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:31.508210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:31.508711 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] PATH_INFO: `/v3/projects/ee87f2655ab14499aebd1b4f9643336b` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:31.510307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee87f2655ab14499aebd1b4f9643336b)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:31.513094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:31.593519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee87f2655ab14499aebd1b4f9643336b', 'request_id': 'req-0f48fdfa-4749-4d2e-8f63-e5534c49f243'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.603233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee87f2655ab14499aebd1b4f9643336b', 'request_id': 'req-0f48fdfa-4749-4d2e-8f63-e5534c49f243'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.622488 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee87f2655ab14499aebd1b4f9643336b', 'request_id': 'req-0f48fdfa-4749-4d2e-8f63-e5534c49f243'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.645585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] The token cache is being invalidate because project ee87f2655ab14499aebd1b4f9643336b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:31.646206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.647147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.649857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1211/2462] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:31 2022] DELETE /identity/v3/projects/ee87f2655ab14499aebd1b4f9643336b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:31.653638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:31.665275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee907d-c245-4925-a206-268afb88f2da service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:31.759080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:31.760776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:31.761774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:31.762239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] PATH_INFO: `/v3/users/6562ad0e347f4f749f04f871523834f6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:31.764451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6562ad0e347f4f749f04f871523834f6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:31.768580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:31.859111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6562ad0e347f4f749f04f871523834f6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.868139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6562ad0e347f4f749f04f871523834f6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.878651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6562ad0e347f4f749f04f871523834f6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.880592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6562ad0e347f4f749f04f871523834f6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.884724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2aa6a839-4438-4761-8d15-9bbf27fbe40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6562ad0e347f4f749f04f871523834f6'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:31.912912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1252/2463] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:31 2022] DELETE /identity/v3/users/6562ad0e347f4f749f04f871523834f6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:32.407773 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:32.409481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:32.441340 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48fdfa-4749-4d2e-8f63-e5534c49f243 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:32.541187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:32.542073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:32.542359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:32.542673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] PATH_INFO: `/v3/projects/21e895297d4a406dbb9277d9267c3690` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:32.543893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e895297d4a406dbb9277d9267c3690)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:32.545977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:32.611124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e895297d4a406dbb9277d9267c3690', 'request_id': 'req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:32.619594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e895297d4a406dbb9277d9267c3690', 'request_id': 'req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:32.629478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e895297d4a406dbb9277d9267c3690', 'request_id': 'req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:32.643840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] The token cache is being invalidate because project 21e895297d4a406dbb9277d9267c3690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:32.644453 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:32.645454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-765b62f6-1b65-4b23-bed0-3f7e3cdae7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:32.650949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1212/2464] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:32 2022] DELETE /identity/v3/projects/21e895297d4a406dbb9277d9267c3690 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:32.652591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:32.653049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:32.653579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:32.674226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:32.678176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:32.752031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1253/2465] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:32.763449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:32.763814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:32.764167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:32.784122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:32.786164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:32.794389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1213/2466] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:32.798951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:32.811300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fa2f-c27f-4b68-817d-b70a68e8fe38 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:32.816020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:32.816734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:32.817020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:32.817299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:32.818042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:32.818357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:32.820013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:32.840060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1254/2467] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:32.844247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:32.858803 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5e98b-a22b-4d43-a1dd-92401fb69617 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:32.863834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:32.864491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:32.864782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:32.865191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:32.866251 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:32.868800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:32.924752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:32.926618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1214/2468] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:32 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:32.939246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800d22b-57fc-4169-b9a4-cebbcd3ec868 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.016158 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.016865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.017147 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.017423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.018112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.020638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.043297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1255/2469] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:32 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:33.047174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.057676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8334a8-ba70-4f41-b58c-0eca1d312779 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.064143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.064869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.065236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.065536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.066355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.068130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.079542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1215/2470] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:33.083833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.094292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31ca33-9f46-41eb-b6ea-4b8eb9980df9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.100267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.100945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.101236 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.101508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.102978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.104619 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f6495-2018-46be-ad52-c724720fac6d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.118866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1256/2471] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:33.120009 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.131612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07559bc-39e2-44fe-b97a-556f330d02e7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.136683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.137684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.138069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.138585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] PATH_INFO: `/v3/projects/0af3ec9524b647a6b94f520680851928/users/91500a1729514b319ae59515db940f03/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.167106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af3ec9524b647a6b94f520680851928, user_id=91500a1729514b319ae59515db940f03, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.169787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.186032 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1216/2472] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:33 2022] PUT /identity/v3/projects/0af3ec9524b647a6b94f520680851928/users/91500a1729514b319ae59515db940f03/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:33.198530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.198830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.199139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.228313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] MFA Rules not processed for user `91500a1729514b319ae59515db940f03`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:33.229533 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:33.318175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1257/2473] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:33.323110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.416235 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3665d7-bc3f-4ebe-9881-5ab93057f4c6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.423373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.424178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.424558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.424957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.425775 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.428349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.479160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1217/2474] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:33 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:33.481164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.493954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688046-515b-4fb2-92b1-b0e1d147736c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.574559 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.575332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.576044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.576044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.576661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.578675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.612626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1258/2475] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:33 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:33.614442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.634361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a68a-a8c6-45e8-8699-b1ee8028f01d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.643585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.645175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.645687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.646188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.647210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.649135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.662087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1218/2476] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:33.666280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.677375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed59be-b4a4-4361-9fba-4b2717110186 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.719957 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.721099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.721448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.721731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] PATH_INFO: `/v3/projects/e9ce3269925a4889996f8c006e6cf239/users/998628e6d2a8412bb6000da7ea46a6ba/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.740873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ce3269925a4889996f8c006e6cf239, user_id=998628e6d2a8412bb6000da7ea46a6ba, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.744093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.769183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1259/2477] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:33 2022] PUT /identity/v3/projects/e9ce3269925a4889996f8c006e6cf239/users/998628e6d2a8412bb6000da7ea46a6ba/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:33.773575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.784387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968757f-f734-471e-aacf-2783fb804151 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.849499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.850200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.850483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.850774 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.851508 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.853181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116b5de-08ee-43c4-8d2a-7ee48ef6deea admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.867283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1219/2478] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:33.868580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:33.886053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73204c-69df-4bcc-844d-ca31952b5871 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:33.890925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:33.891867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.892157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.892435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] PATH_INFO: `/v3/projects/e9ce3269925a4889996f8c006e6cf239/users/998628e6d2a8412bb6000da7ea46a6ba/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.895153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ce3269925a4889996f8c006e6cf239, user_id=998628e6d2a8412bb6000da7ea46a6ba, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:33.897917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:33.909982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1260/2479] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:33 2022] PUT /identity/v3/projects/e9ce3269925a4889996f8c006e6cf239/users/998628e6d2a8412bb6000da7ea46a6ba/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:33.920586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:33.920875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:33.921376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:33.954224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] MFA Rules not processed for user `998628e6d2a8412bb6000da7ea46a6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:33.970500 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:34.031305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1220/2480] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:34.040950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:34.042682 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:34.111618 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682090a-fa71-493e-ada1-4ae4a5a5647e admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:34.117840 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:34.118689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:34.118900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:34.119245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:34.130765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:34.136206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe950f-ee54-4fa3-9b6d-85b780226131 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:34.147611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1261/2481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:34.221444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:34.295999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962509-84e4-4de2-b742-7549cbaf800d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:34.301346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:34.302298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:34.302679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:34.303022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] PATH_INFO: `/v3/users/91500a1729514b319ae59515db940f03` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:34.304308 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91500a1729514b319ae59515db940f03)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:34.306339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:34.366387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91500a1729514b319ae59515db940f03'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:34.374304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91500a1729514b319ae59515db940f03'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:34.375130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91500a1729514b319ae59515db940f03'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:34.390451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91500a1729514b319ae59515db940f03'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:34.391199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91500a1729514b319ae59515db940f03'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:34.408319 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1221/2482] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:34 2022] DELETE /identity/v3/users/91500a1729514b319ae59515db940f03 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:34.413296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:34.414008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:34.415288 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:34.437065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:34.438850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:34.523520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1262/2483] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:34.533555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:34.535153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:34.622110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d3422-6239-4132-92fb-de47c5d76119 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:34.630811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:34.631630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:34.631924 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:34.632199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:34.669177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:34.675811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:34.693537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1222/2484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:35.047228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:35.048834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:35.071165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea045dfd-68b6-4dd7-944e-937208b4f97e None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:35.083802 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:35.084683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:35.084966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:35.085241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] PATH_INFO: `/v3/projects/0af3ec9524b647a6b94f520680851928` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:35.086477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af3ec9524b647a6b94f520680851928)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:35.089237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:35.151371 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af3ec9524b647a6b94f520680851928', 'request_id': 'req-343a0fc6-f28a-4f2c-96c8-f342f1827306'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.159062 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af3ec9524b647a6b94f520680851928', 'request_id': 'req-343a0fc6-f28a-4f2c-96c8-f342f1827306'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.165763 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af3ec9524b647a6b94f520680851928', 'request_id': 'req-343a0fc6-f28a-4f2c-96c8-f342f1827306'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.184630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] The token cache is being invalidate because project 0af3ec9524b647a6b94f520680851928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:35.184996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.185654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.190341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1263/2485] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:35 2022] DELETE /identity/v3/projects/0af3ec9524b647a6b94f520680851928 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:35.191450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:35.201813 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5a22-c37d-4d33-808a-8b0261e355f4 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:35.273167 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:35.276841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:35.277441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:35.277907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] PATH_INFO: `/v3/users/998628e6d2a8412bb6000da7ea46a6ba` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:35.279314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] RBAC: Authorizing `identity:delete_user(user_id=998628e6d2a8412bb6000da7ea46a6ba)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:35.281268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:35.341163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998628e6d2a8412bb6000da7ea46a6ba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.350888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998628e6d2a8412bb6000da7ea46a6ba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.351846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998628e6d2a8412bb6000da7ea46a6ba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.367725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998628e6d2a8412bb6000da7ea46a6ba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.368441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-7a24bbd7-2d78-4b79-8179-e4f82a93138b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998628e6d2a8412bb6000da7ea46a6ba'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.387481 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1223/2486] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:35 2022] DELETE /identity/v3/users/998628e6d2a8412bb6000da7ea46a6ba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:35.711359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:35.712950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:35.743367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0fc6-f28a-4f2c-96c8-f342f1827306 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:35.813104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:35.814113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:35.814467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:35.814833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] PATH_INFO: `/v3/projects/e9ce3269925a4889996f8c006e6cf239` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:35.816214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ce3269925a4889996f8c006e6cf239)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:35.818887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:35.875335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ce3269925a4889996f8c006e6cf239', 'request_id': 'req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.882424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ce3269925a4889996f8c006e6cf239', 'request_id': 'req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.888494 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ce3269925a4889996f8c006e6cf239', 'request_id': 'req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.914170 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] The token cache is being invalidate because project e9ce3269925a4889996f8c006e6cf239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:35.914712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.917446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4a1a6b8e-2b6a-4e9e-a69e-b19c3f69b66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:35.923485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1264/2487] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:35 2022] DELETE /identity/v3/projects/e9ce3269925a4889996f8c006e6cf239 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:35.926207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:35.927049 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:35.927330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:35.954703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:35.955915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:36.029486 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1224/2488] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:36.037382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.037875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.038253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.060889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:36.062105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:36.067479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.069285 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:36.092228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1265/2489] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:36.093829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.117160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e608a-2cd7-476d-9dd9-e87c103aaa8b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.134428 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.135136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.135530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.135813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.136544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:36.136851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.138587 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.161762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1266/2490] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:36.163266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.171880 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a06c-62c1-4527-b356-935c18356a2f None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.173567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621e71-4cce-4bd6-ab91-4b366d6b7ebf admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.179700 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.180728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.181180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.181619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.181747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.182518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.182875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.183342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.184063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.184339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:36.186239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.197129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.198623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.217542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1267/2491] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:36.218996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1225/2492] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:36.221631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.317723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74677c73-36f8-49ac-97ab-6baed528c44a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.331688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.332412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.332699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.332971 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.333730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.335783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.365052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1268/2493] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:36.366482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.386580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413e19-5cfb-4619-a7d0-ecfbcf80a379 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.391714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.392635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.393127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.393560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.394630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.396454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.413918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1226/2494] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:36.415275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.431798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13719-6837-463f-8673-41a68b0cdbab admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.439332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.440606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.441076 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.442179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.443157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.445006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fae5b-a1d0-4646-8e22-f30a5c8bacb7 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.456344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1269/2495] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:36.460980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.476410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc904-324e-4904-8c85-a98a05a15808 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.482236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.483435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.483780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.484148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] PATH_INFO: `/v3/projects/e0c3900c28f04cd39e243c1ac90fba7d/users/dc74bacec23b44d9bb94695b4c4e05f8/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.503551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c3900c28f04cd39e243c1ac90fba7d, user_id=dc74bacec23b44d9bb94695b4c4e05f8, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.506823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.537680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1227/2496] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:36 2022] PUT /identity/v3/projects/e0c3900c28f04cd39e243c1ac90fba7d/users/dc74bacec23b44d9bb94695b4c4e05f8/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:36.551876 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.552687 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.553140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.587190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] MFA Rules not processed for user `dc74bacec23b44d9bb94695b4c4e05f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:36.589409 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:36.677173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1270/2497] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:36.678066 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.828663 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08b44-7f94-48fc-9cd9-3c185f9744a7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:36.841490 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:36.844072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:36.844588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:36.845064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:36.845975 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:36.849213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:36.935664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1228/2498] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:36.937930 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:36.951022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0a54a-08f7-4933-91ce-6dcafc1e527d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.051572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.052689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.053074 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.053351 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.054100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.056617 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.103534 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1271/2499] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:36 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:37.107447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.119222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f00486-96d0-44cc-990c-eef59b8a872b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.124164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.124879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.125147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.125543 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.126185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.127837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.144948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.150279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1229/2500] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:37.180230 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceee97-add9-4da5-bd5d-038490510369 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.206046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.209616 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.209902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.210250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] PATH_INFO: `/v3/projects/6ed7718be3054f9198dbaad30665e4a8/users/8558eeaa5c77439694483ed87dfe187f/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.229925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed7718be3054f9198dbaad30665e4a8, user_id=8558eeaa5c77439694483ed87dfe187f, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.232797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.257675 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1272/2501] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:37 2022] PUT /identity/v3/projects/6ed7718be3054f9198dbaad30665e4a8/users/8558eeaa5c77439694483ed87dfe187f/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:37.259269 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.275338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e50c2-145f-40cb-9bd0-b830a8ff79bd admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.361596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.362785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.363805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.364337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.365288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.368432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014d54-2619-4daa-a046-784f47d01ce0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.385441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1230/2502] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:37.389491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.407022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aad471-dca1-4185-a969-9af26ede10d6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.408836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.409760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.410053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.410334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] PATH_INFO: `/v3/projects/6ed7718be3054f9198dbaad30665e4a8/users/8558eeaa5c77439694483ed87dfe187f/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.413237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed7718be3054f9198dbaad30665e4a8, user_id=8558eeaa5c77439694483ed87dfe187f, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.415794 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.438926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1273/2503] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:37 2022] PUT /identity/v3/projects/6ed7718be3054f9198dbaad30665e4a8/users/8558eeaa5c77439694483ed87dfe187f/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:37.440574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.440870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.441851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.474287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] MFA Rules not processed for user `8558eeaa5c77439694483ed87dfe187f`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:37.475459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:37.594504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1231/2504] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:37.604386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.606594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:37.680327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09abd4-e2ef-4b27-a21d-1555f5563fb6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.684172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.686531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.686531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.686531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.695983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.698046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.723176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1274/2505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:02:37.820554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:37.831856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6752f3-016c-4bef-a2e8-df3c20b77036 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:37.841641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:37.842413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:37.842800 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:37.843147 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:37.931614 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:37.933378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:37.947715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1232/2506] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:40.322722 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.324237 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.387271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cac1bf-f93a-4474-8d4b-14cf0600f9bf service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.391842 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.392708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.392995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.393383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] PATH_INFO: `/v3/users/2751fce03c284a91b152f545bd8c63ce` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.394545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2751fce03c284a91b152f545bd8c63ce)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.396499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:40.444491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2751fce03c284a91b152f545bd8c63ce'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.451093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2751fce03c284a91b152f545bd8c63ce'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.458695 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2751fce03c284a91b152f545bd8c63ce'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.459306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2751fce03c284a91b152f545bd8c63ce'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.459916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2751fce03c284a91b152f545bd8c63ce'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.476810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1275/2507] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:40 2022] DELETE /identity/v3/users/2751fce03c284a91b152f545bd8c63ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:40.589208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.601381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7719-14a4-4279-aca1-faa06daa8a70 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.664184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.666373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.667220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.667468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.667725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.668113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] PATH_INFO: `/v3/users/dc74bacec23b44d9bb94695b4c4e05f8` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.669506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc74bacec23b44d9bb94695b4c4e05f8)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.671676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:40.681321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9535f2-2ae6-46cb-a443-197c3f924675 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.695970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.696846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.697117 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.697448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] PATH_INFO: `/v3/projects/477a9d7174e544efbbe7803ca7e77521` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.699231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=477a9d7174e544efbbe7803ca7e77521)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.702343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:40.722912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc74bacec23b44d9bb94695b4c4e05f8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.730068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc74bacec23b44d9bb94695b4c4e05f8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.730842 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc74bacec23b44d9bb94695b4c4e05f8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.742764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc74bacec23b44d9bb94695b4c4e05f8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.743415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-81405adc-058a-48a2-b589-6a83b134cea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc74bacec23b44d9bb94695b4c4e05f8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.750872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477a9d7174e544efbbe7803ca7e77521', 'request_id': 'req-745e5614-0488-46d5-bd27-901776a2f93c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.756693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1233/2508] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:40 2022] DELETE /identity/v3/users/dc74bacec23b44d9bb94695b4c4e05f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:40.758566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477a9d7174e544efbbe7803ca7e77521', 'request_id': 'req-745e5614-0488-46d5-bd27-901776a2f93c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.761556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.761849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.762135 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.764260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477a9d7174e544efbbe7803ca7e77521', 'request_id': 'req-745e5614-0488-46d5-bd27-901776a2f93c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.777588 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] The token cache is being invalidate because project 477a9d7174e544efbbe7803ca7e77521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:40.777877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.778555 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-745e5614-0488-46d5-bd27-901776a2f93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:40.780095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1276/2509] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:40 2022] DELETE /identity/v3/projects/477a9d7174e544efbbe7803ca7e77521 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:40.783451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:40.783451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.784814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000bb9-a03d-4b9b-aabe-5cbe52c92629 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.785101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000bb9-a03d-4b9b-aabe-5cbe52c92629 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.785378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000bb9-a03d-4b9b-aabe-5cbe52c92629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.803406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-71000bb9-a03d-4b9b-aabe-5cbe52c92629 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:40.804600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-71000bb9-a03d-4b9b-aabe-5cbe52c92629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.844983 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1234/2510] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:40.854871 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.856385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.866054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1277/2511] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:40.874963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.875273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.875527 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.894711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:40.895897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:40.904133 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1278/2512] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:40.908181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.917083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ea7f-bd95-400f-8044-4cb76b569a9a None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.921980 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.922570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda186f-96c5-47d6-a3ad-d85b544465f3 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.925541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.925838 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.926119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.926341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.926993 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:40.927113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.927286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.927400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.927578 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.929462 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:40.937548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.939043 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:40.942518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1279/2513] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:40.946594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:40.952942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1235/2514] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:02:40.957645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11977e5-2d25-4935-94bc-50ded51e0b7b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:40.962567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:40.963229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:40.963515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:40.963793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:40.964484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:40.966393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.010512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1280/2515] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:40 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:41.014156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.024602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769f56f-4aab-42bb-a4ab-e0c37e49c016 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.087903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.088501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.088787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.089163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.089739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.091709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.114033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1236/2516] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:41 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:41.118080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.128754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771067cc-0ddd-4c6a-a34c-10850d87d5a0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.134491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.135688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.135903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.136139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.136873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.138529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.151471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1281/2517] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:41.155855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.168284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440bbc-27e7-4409-b74c-94c317ee176a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.177442 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.178353 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.178678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.178965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.179707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.181355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.192367 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1237/2518] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:41.196310 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.207035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af574db-8c21-47fa-8646-da6926c0e574 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.211449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.212417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.212704 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.212982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] PATH_INFO: `/v3/projects/817a6378c66741109ec7f66c9ff8693f/users/d9ffd39fe6f54066b79a4be017a9a159/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.229996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817a6378c66741109ec7f66c9ff8693f, user_id=d9ffd39fe6f54066b79a4be017a9a159, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.232902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f3b82-2c33-47e9-8c16-d11d1e42f375 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.254553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1282/2519] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:41 2022] PUT /identity/v3/projects/817a6378c66741109ec7f66c9ff8693f/users/d9ffd39fe6f54066b79a4be017a9a159/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:41.264343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.264789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.265100 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.265553 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.266129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.282556 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0d54-7804-4e6c-83e0-418ed61f5a3f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.298031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] MFA Rules not processed for user `d9ffd39fe6f54066b79a4be017a9a159`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:41.299444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.341355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.342133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.342417 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.342735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] PATH_INFO: `/v3/projects/e0c3900c28f04cd39e243c1ac90fba7d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.343909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c3900c28f04cd39e243c1ac90fba7d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.345908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.364950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1283/2520] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:41.369717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.380614 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b896-0eed-4f10-bd24-921e82694b46 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.395843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c3900c28f04cd39e243c1ac90fba7d', 'request_id': 'req-6f889f31-a684-442e-b657-2fa56bd16f0f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.402329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c3900c28f04cd39e243c1ac90fba7d', 'request_id': 'req-6f889f31-a684-442e-b657-2fa56bd16f0f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.411190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c3900c28f04cd39e243c1ac90fba7d', 'request_id': 'req-6f889f31-a684-442e-b657-2fa56bd16f0f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.423222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] The token cache is being invalidate because project e0c3900c28f04cd39e243c1ac90fba7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:41.423512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.424789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.426951 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1238/2521] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:41 2022] DELETE /identity/v3/projects/e0c3900c28f04cd39e243c1ac90fba7d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:41.431420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.432894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.444407 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.445124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.445359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.445635 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.446322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.448446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.476474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1284/2522] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:41 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:41.480306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.481935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.512432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f889f31-a684-442e-b657-2fa56bd16f0f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.550811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc0b1b-1e13-47e9-ac6f-8494eea4a2a9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.555556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.556242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.556510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.556801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.557481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.559445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.574450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.575368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.575658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.575934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] PATH_INFO: `/v3/users/8558eeaa5c77439694483ed87dfe187f` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.577148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8558eeaa5c77439694483ed87dfe187f)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.579115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.579464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1285/2523] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:41 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:41.583828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.593405 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a025-9f83-49ca-acde-d4aab9c2270d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.598065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.598744 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.599027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.599303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.600015 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.601594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.614911 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1286/2524] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:41.615997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.625708 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8558eeaa5c77439694483ed87dfe187f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.626173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a312365-8847-4a1c-bb7c-5873f883887a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.631291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.632146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.632434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.632718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] PATH_INFO: `/v3/projects/436dd83da4bb49f69a2266ea586f7009/users/13a0bb0f0c174e3fb3ce824031be09c1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.633151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8558eeaa5c77439694483ed87dfe187f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.633919 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8558eeaa5c77439694483ed87dfe187f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.646378 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8558eeaa5c77439694483ed87dfe187f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.647456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8558eeaa5c77439694483ed87dfe187f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:41.648154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436dd83da4bb49f69a2266ea586f7009, user_id=13a0bb0f0c174e3fb3ce824031be09c1, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.650903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.660616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1239/2525] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:41 2022] DELETE /identity/v3/users/8558eeaa5c77439694483ed87dfe187f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:41.663711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1287/2526] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:41 2022] PUT /identity/v3/projects/436dd83da4bb49f69a2266ea586f7009/users/13a0bb0f0c174e3fb3ce824031be09c1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:41.670823 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.672236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.748934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ec5c4-bbc3-43fb-a01e-c53240365290 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.754192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.754887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.755172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.755452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.756180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.757782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848e00c-67e7-4262-8f6c-582c0f698c62 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.770122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1240/2527] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:41.774301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.849986 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ea235-6b9e-4104-bf95-35fe5c811109 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:41.854694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:41.855578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.855863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.856140 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] PATH_INFO: `/v3/projects/436dd83da4bb49f69a2266ea586f7009/users/13a0bb0f0c174e3fb3ce824031be09c1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.858663 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436dd83da4bb49f69a2266ea586f7009, user_id=13a0bb0f0c174e3fb3ce824031be09c1, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:41.861123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:41.872548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1288/2528] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:41 2022] PUT /identity/v3/projects/436dd83da4bb49f69a2266ea586f7009/users/13a0bb0f0c174e3fb3ce824031be09c1/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:41.883237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:41.883561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:41.883840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:41.909957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] MFA Rules not processed for user `13a0bb0f0c174e3fb3ce824031be09c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:41.911324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.930832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:41.932546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:41.985786 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1241/2529] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:41.999531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.000926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.004413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de3f45-cfe9-4499-ac58-913d6ee14498 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.009546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.010604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.010890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.011166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] PATH_INFO: `/v3/projects/6ed7718be3054f9198dbaad30665e4a8` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.012360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed7718be3054f9198dbaad30665e4a8)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.015613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.062095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888f68-9d7c-49f5-837e-92088354e787 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.062605 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed7718be3054f9198dbaad30665e4a8', 'request_id': 'req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.069897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed7718be3054f9198dbaad30665e4a8', 'request_id': 'req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.076741 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed7718be3054f9198dbaad30665e4a8', 'request_id': 'req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.091159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] The token cache is being invalidate because project 6ed7718be3054f9198dbaad30665e4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:42.091503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.092583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2a1b26ac-032b-4e94-be88-242ec4c7b7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.094379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1289/2530] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:41 2022] DELETE /identity/v3/projects/6ed7718be3054f9198dbaad30665e4a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:42.099377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bf53-1beb-4877-b374-af9501a4765c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.099693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bf53-1beb-4877-b374-af9501a4765c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.099976 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4bf53-1beb-4877-b374-af9501a4765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.117113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.117889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.118246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.118712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.118817 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-0ee4bf53-1beb-4877-b374-af9501a4765c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:42.120153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0ee4bf53-1beb-4877-b374-af9501a4765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.120657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.184806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1290/2531] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:42.192490 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.192774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.193058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.199883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.202053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.212316 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:42.213587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1242/2532] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:42.213708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.225532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1291/2533] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:42.226962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.239171 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90620c-372f-4980-80b8-c717f9393469 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.244205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.244863 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.245148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.245416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.246139 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:42.246447 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.248077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.264472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1243/2534] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:42.265359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.275483 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee393-ec3a-410f-bb3a-7ee6db942de5 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.284406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.284406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.284406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.284406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.285470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.285470 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.315148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1292/2535] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:42.319761 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.331554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03ca36-5a53-4146-ae98-fcc586289cbc admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.406347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.407071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.407341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.407616 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.408310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.410831 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.437962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1244/2536] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:42.439169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.452293 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d9e82-5df8-40a7-af19-3c7c54cc9eb6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.458656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.459558 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.459963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.460552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.461513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.463306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.475873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1293/2537] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:42.479780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.490811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef9c5-45b3-46e6-abde-6ef135ef0d85 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.496559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.497414 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.497709 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.497979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.498820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.500371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332ef9f-a26d-47b6-9b3d-713a18fb9fc0 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.518509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1245/2538] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:42.520832 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.533707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6afd-fa06-4d77-b5e9-743cdd60c01f admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.542636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.542636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.542636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.542636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] PATH_INFO: `/v3/projects/b40669ae3197401499f50c4da1f12d60/users/31f18e79756b45ef92f568d069d515d4/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.562010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40669ae3197401499f50c4da1f12d60, user_id=31f18e79756b45ef92f568d069d515d4, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.565052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.584233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1294/2539] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:42 2022] PUT /identity/v3/projects/b40669ae3197401499f50c4da1f12d60/users/31f18e79756b45ef92f568d069d515d4/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:42.595881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.596408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.596692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.627381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] MFA Rules not processed for user `31f18e79756b45ef92f568d069d515d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:42.628577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.651897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.653603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.704499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1246/2540] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:42.710075 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.724111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46b21c-9f0c-4154-a987-e7d5dbc038ef admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.728938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.729807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.730094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.730374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] PATH_INFO: `/v3/users/d9ffd39fe6f54066b79a4be017a9a159` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.731714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ffd39fe6f54066b79a4be017a9a159)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.733649 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.786291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885dbe-bb30-4b7e-a976-c82c41b6483d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.788546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ffd39fe6f54066b79a4be017a9a159'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.792922 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.793821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.794106 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.794381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.795551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.796583 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ffd39fe6f54066b79a4be017a9a159'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.797477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8134e3-9fba-4d29-9e53-c9967c588d0c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.806631 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ffd39fe6f54066b79a4be017a9a159'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.808142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ffd39fe6f54066b79a4be017a9a159'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.809125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-312ace7f-b3e1-4612-90c5-07ea77fd61aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ffd39fe6f54066b79a4be017a9a159'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:42.828005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1247/2541] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:42.829496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.829844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.830129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.832255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1248/2542] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:02:42.832954 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.834361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1295/2543] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:42 2022] DELETE /identity/v3/users/d9ffd39fe6f54066b79a4be017a9a159 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:42.834682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.838657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a994-b2e3-4fbb-8f59-cdf98720f256 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.839222 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a994-b2e3-4fbb-8f59-cdf98720f256 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.839900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13a994-b2e3-4fbb-8f59-cdf98720f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.860313 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2f13a994-b2e3-4fbb-8f59-cdf98720f256 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:42.861821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2f13a994-b2e3-4fbb-8f59-cdf98720f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.911536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67717e-f0bb-4ecb-ac9e-80e48cf80ff9 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:42.916137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:42.916923 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.917093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.917370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.918069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:42.920191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:42.923640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1296/2544] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:42.925112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:42.925595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:42.925987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:42.945293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1249/2545] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:42.945293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:42.945293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:42.978154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:42.978154 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.007377 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e69f8-1591-4da0-a027-8f922ea49e3e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.011095 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.011747 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.012034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.012320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.022853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.024452 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.033933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1250/2546] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:43.034772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.043637 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73275bf-6649-4016-af45-255e8310c4bd service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.048283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.048529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1297/2547] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:43.049299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.049588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.049930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.050726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.052325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.060952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.062424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.067618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1251/2548] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:43.068615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.080209 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe363ea-c4c9-4b06-8d49-208cb550ad1a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.087351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.087943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.088373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.088763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.089674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.091459 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.104905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1252/2549] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:43.105949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.116271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fd931-623c-4ff4-9b9d-5b95a6df2d53 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.122087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.123193 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.123476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.123845 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] PATH_INFO: `/v3/projects/2b19f4b6934f455a873e5b167871be1f/users/9aa87457778d449fb2512dfae6543e19/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.141220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b19f4b6934f455a873e5b167871be1f, user_id=9aa87457778d449fb2512dfae6543e19, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.144610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef85fe-4bee-49c3-a88f-2c521ff5e36c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.161741 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1253/2550] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:43 2022] PUT /identity/v3/projects/2b19f4b6934f455a873e5b167871be1f/users/9aa87457778d449fb2512dfae6543e19/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:43.169349 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d55e98-0b51-4cf5-a163-cf37adeb7cd3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.172237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.172699 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.172977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.205660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] MFA Rules not processed for user `9aa87457778d449fb2512dfae6543e19`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:43.207776 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.229084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.229742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.230511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.230511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.283936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1254/2551] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:43.287843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.306728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.308360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.322941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1298/2552] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:02:43.333239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.335347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.375874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f7014-ef9e-4221-9ed3-e84a2cd3b9d5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.382948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.383692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.384044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.384419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.385376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.387566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590d754-87e6-4b84-ab44-74431bf3c049 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.413797 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba905a-9f4c-4996-a78e-844b9c202a18 service glance] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.421099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1255/2553] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:43.421263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.421390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56592-e396-4780-9d84-bee8625be9a4 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.421492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.421589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56592-e396-4780-9d84-bee8625be9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.421688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.421790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56592-e396-4780-9d84-bee8625be9a4 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.421889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] PATH_INFO: `/v3/projects/817a6378c66741109ec7f66c9ff8693f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.421978 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1256/2554] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 20:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:02:43.422360 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56592-e396-4780-9d84-bee8625be9a4 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.422946 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817a6378c66741109ec7f66c9ff8693f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.424921 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.471068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817a6378c66741109ec7f66c9ff8693f', 'request_id': 'req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.477385 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817a6378c66741109ec7f66c9ff8693f', 'request_id': 'req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.482837 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817a6378c66741109ec7f66c9ff8693f', 'request_id': 'req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.487205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56592-e396-4780-9d84-bee8625be9a4 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.495798 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] The token cache is being invalidate because project 817a6378c66741109ec7f66c9ff8693f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:43.496160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.496943 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-297b0e07-ddb3-411b-bb7c-86078c5ab1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.498518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1299/2555] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:43 2022] DELETE /identity/v3/projects/817a6378c66741109ec7f66c9ff8693f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:43.499733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.500021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.500295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.518320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:43.519598 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.551345 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.552016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.552303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.552604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.553300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.555304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.571104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1300/2556] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:43.575332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.576189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1257/2557] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:43.576732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.579945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.581572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.590923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606862-70bd-450e-9a9b-a441fdac8d89 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.593262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81ba6e-fe86-4324-8c80-b53ecbfb651c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.595531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.596392 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.596677 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.597489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] PATH_INFO: `/v3/users/13a0bb0f0c174e3fb3ce824031be09c1` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.598704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.598852 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a0bb0f0c174e3fb3ce824031be09c1)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.599347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.599630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.599905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.600619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.600734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.602227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.611884 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1258/2558] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:43.613931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.615584 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.628789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faac95e-d5b2-432c-861f-4a2dd31e62b6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.632893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.633575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.633852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.634115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.641625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.643069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.648573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a0bb0f0c174e3fb3ce824031be09c1'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.654904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1259/2559] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:43.654904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.655938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a0bb0f0c174e3fb3ce824031be09c1'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.665142 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a0bb0f0c174e3fb3ce824031be09c1'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.666155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a0bb0f0c174e3fb3ce824031be09c1'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.666829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a0bb0f0c174e3fb3ce824031be09c1'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:43.671168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773b05b-5086-4070-b4fc-b994811bbdf7 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.676440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.677689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.678112 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.678386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] PATH_INFO: `/v3/projects/8d7124941c764f808bd88eec124c068a/users/0903530b1d3c408f8f316b62c1874897/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.688321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1301/2560] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:43 2022] DELETE /identity/v3/users/13a0bb0f0c174e3fb3ce824031be09c1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:43.694942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7124941c764f808bd88eec124c068a, user_id=0903530b1d3c408f8f316b62c1874897, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.697799 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef24d0e-d774-464d-bf96-1395681b39cd admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.713617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1260/2561] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:43 2022] PUT /identity/v3/projects/8d7124941c764f808bd88eec124c068a/users/0903530b1d3c408f8f316b62c1874897/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:43.717412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.719246 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.748332 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9dfb5-f62e-43d6-adc0-cfbb2fc43991 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.748851 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9dfb5-f62e-43d6-adc0-cfbb2fc43991 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.749182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9dfb5-f62e-43d6-adc0-cfbb2fc43991 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.751833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1261/2562] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 20:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:02:43.757471 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.758206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.759382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.778096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:43.779619 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.793708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd4b4-629f-4a2a-8c46-1321f28a677b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.858180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.858884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.859306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.859578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.860341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.861968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.863820 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1262/2563] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:43.874772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.876206 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:43.877717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1302/2564] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:43.882343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:43.892575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5b75c-7f80-48ae-a075-0b75b33ea694 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.897996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:43.899083 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.899204 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.899438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] PATH_INFO: `/v3/projects/8d7124941c764f808bd88eec124c068a/users/0903530b1d3c408f8f316b62c1874897/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.901536 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7124941c764f808bd88eec124c068a, user_id=0903530b1d3c408f8f316b62c1874897, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:43.904416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b892d-fbd0-4b9f-af60-009d8cee411f admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:43.918505 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1303/2565] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:43 2022] PUT /identity/v3/projects/8d7124941c764f808bd88eec124c068a/users/0903530b1d3c408f8f316b62c1874897/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:43.927881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:43.928606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:43.929049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:43.935388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea33645-1d80-4080-928d-6d841e5cfed0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:43.972730 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] MFA Rules not processed for user `0903530b1d3c408f8f316b62c1874897`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:43.973972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.001671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.002855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.003520 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.003984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.067924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1304/2566] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:44.068793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.070319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.093889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.095390 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.109358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1263/2567] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:02:44.110195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.111494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.137600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5a17-3cf0-407b-a31f-3a3924c3186d None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.142487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.143563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.144783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.145065 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] PATH_INFO: `/v3/projects/436dd83da4bb49f69a2266ea586f7009` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.148281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=436dd83da4bb49f69a2266ea586f7009)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.150220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.179294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1b6a1-c8e8-4a95-a024-f89a0aa29600 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.187789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.188713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.189079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.189439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.191807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.208363 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436dd83da4bb49f69a2266ea586f7009', 'request_id': 'req-4f01f074-58d4-405b-bbba-e3a8e439e49c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:44.216066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436dd83da4bb49f69a2266ea586f7009', 'request_id': 'req-4f01f074-58d4-405b-bbba-e3a8e439e49c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:44.222902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436dd83da4bb49f69a2266ea586f7009', 'request_id': 'req-4f01f074-58d4-405b-bbba-e3a8e439e49c'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:44.238711 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] The token cache is being invalidate because project 436dd83da4bb49f69a2266ea586f7009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:44.239001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:44.239691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4f01f074-58d4-405b-bbba-e3a8e439e49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:44.241801 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1305/2568] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:44 2022] DELETE /identity/v3/projects/436dd83da4bb49f69a2266ea586f7009 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:44.246379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.246700 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.246981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.254056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.255739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77401859-ffe8-4ea1-8513-bf2c30cb7f8c service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.265812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1264/2569] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:44.265996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:44.267526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.334092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1306/2570] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:44.343670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.343965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.344300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.363890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:44.365089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.377439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1265/2571] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:44.378484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.388499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf945f7-1cf4-4c1a-adcc-33c75e09e4a8 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.394114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.395057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.395453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.395867 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.397302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:44.397302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.398846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.412769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1307/2572] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:44.417253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.428010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520666-3e65-4e1d-ae56-2020d8076eee None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.433462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.434151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.434439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.434760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.435467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.437406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.468337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1266/2573] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:44.474269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.491276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79d9c5-8495-4d9d-b52b-c3c7e98abf28 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.567997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.568681 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.568972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.569257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.569953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.572084 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.598708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1308/2574] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:44.603480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.615133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d251-f062-45cd-8008-f4e68c7d1d42 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.620646 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.621321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.621608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.621915 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.622674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.624318 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.634859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1267/2575] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:44.639287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.649401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b0bf-bc09-4960-aa08-ddc421105aca admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.654150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.654853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.655139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.655412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.656129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.657742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ee70e-f259-4cbb-aba8-3f34fc845a20 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.672148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1309/2576] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:44.673338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.683844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939501-9c86-48a3-bec9-0a031cbb203f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.688387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.689250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.689533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.689810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] PATH_INFO: `/v3/projects/59703ca008a949328897e58718293a90/users/a00757435fa947b8b49736de3b870b89/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.704466 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59703ca008a949328897e58718293a90, user_id=a00757435fa947b8b49736de3b870b89, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.707697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.720769 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1268/2577] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:44 2022] PUT /identity/v3/projects/59703ca008a949328897e58718293a90/users/a00757435fa947b8b49736de3b870b89/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:44.731311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.731607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.731904 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.757602 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] MFA Rules not processed for user `a00757435fa947b8b49736de3b870b89`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:44.758885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:44.822706 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1310/2578] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:44.827203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.889571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5628ea1-cfc4-4ec6-a4b1-2f21d3d9170a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.894840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.895510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.895794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.896126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.896750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.898656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:44.922962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1269/2579] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:44.926862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:44.937264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9b0ad-b39a-4f13-900b-f7dc0425c941 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:44.994329 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:44.995027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:44.995321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:44.995600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:44.996294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:44.998220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.016480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1311/2580] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:44 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:45.020864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.032321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf096b9-9b9a-4a32-8bea-61a0529f5206 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.037444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.038088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.038370 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.038674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.039455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.041173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.053817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1270/2581] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:45.057949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.068927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce4a08-c787-42b1-aaab-8616339eea87 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.073541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.074445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.074762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.075041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] PATH_INFO: `/v3/projects/3c6a4706e07242bc9b34c2c835667ac5/users/0807807d8c704cef87739956cbcb5920/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.091183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6a4706e07242bc9b34c2c835667ac5, user_id=0807807d8c704cef87739956cbcb5920, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.093944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.107092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1312/2582] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:45 2022] PUT /identity/v3/projects/3c6a4706e07242bc9b34c2c835667ac5/users/0807807d8c704cef87739956cbcb5920/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:45.111121 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.121374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7aa9b-4cce-4435-951b-df45c9a31995 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.182667 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.183261 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.183546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.183822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.184537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.186124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efce2-c441-49e8-abf5-badecbd668a9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.196732 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1271/2583] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:45.201028 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.212459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a858db-8b63-412f-8b7b-a2860765ee68 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.217390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.218350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.218724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.219026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] PATH_INFO: `/v3/projects/3c6a4706e07242bc9b34c2c835667ac5/users/0807807d8c704cef87739956cbcb5920/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.221113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6a4706e07242bc9b34c2c835667ac5, user_id=0807807d8c704cef87739956cbcb5920, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.223948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.245612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1313/2584] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:45 2022] PUT /identity/v3/projects/3c6a4706e07242bc9b34c2c835667ac5/users/0807807d8c704cef87739956cbcb5920/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:45.247483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.247739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.248015 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.278509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] MFA Rules not processed for user `0807807d8c704cef87739956cbcb5920`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:45.279726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:45.355528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1272/2585] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:45.368542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.371693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:45.435828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3ccc-8133-458f-a5ea-146708225800 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.439537 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.440185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.440465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.441227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.452010 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.453531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.463292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1314/2586] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:02:45.551456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.561062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320262-a49d-4904-827b-e5139f6f1555 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.565010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.565678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.566004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.566313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.622419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.623901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.632834 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1273/2587] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:45.797833 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.808491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52033d-2246-42f6-b7e9-642ec2305057 service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.815077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.815823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.816196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.816525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.818417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:45.894714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.896269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56fb90-3e6d-428d-94d1-65d9a0932ff3 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:45.910325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1315/2588] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:45.915497 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:45.980262 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc788-a568-4165-b820-2f976a610ca1 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:45.985229 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:45.986089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:45.986373 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:45.986681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] PATH_INFO: `/v3/users/a00757435fa947b8b49736de3b870b89` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:45.988064 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00757435fa947b8b49736de3b870b89)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:45.990630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.041658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00757435fa947b8b49736de3b870b89'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.050416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00757435fa947b8b49736de3b870b89'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.051212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00757435fa947b8b49736de3b870b89'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.065156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00757435fa947b8b49736de3b870b89'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.065976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00757435fa947b8b49736de3b870b89'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.080782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1274/2589] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:45 2022] DELETE /identity/v3/users/a00757435fa947b8b49736de3b870b89 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:46.085665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.085961 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.086243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.105500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:46.106747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.179289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1316/2590] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:46.223161 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:46.225728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.292300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a495c-8bb6-41ab-9770-95ec8ab40516 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:46.296480 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:46.297163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.297449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.297777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.307499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:46.308942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f59a3-9e15-4292-ac74-6d43b3c5b124 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.319839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1275/2591] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:46.478572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:46.480670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.542599 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c98c-c9ea-4431-ba1b-2299a1e37491 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:46.546223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:46.546896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.547880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.548164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.549928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.621356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:46.623124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.634273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1317/2592] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:46.652041 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.652610 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.652889 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.671408 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:46.672934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.732344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:46.733800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.735026 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1276/2593] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:02:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:46.751415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:46.752798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.761742 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b930d-996b-4b3b-ad56-dbad94d6ef3b service cinder] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:46.767227 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:46.768159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.768529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.768888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] PATH_INFO: `/v3/projects/59703ca008a949328897e58718293a90` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.770262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59703ca008a949328897e58718293a90)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:46.772988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.819486 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59703ca008a949328897e58718293a90', 'request_id': 'req-f93067f6-4a0e-4f82-b382-45ecedd8150a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.825194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33810-fd89-4d30-8d3c-cb718b71f81d None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:46.825743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59703ca008a949328897e58718293a90', 'request_id': 'req-f93067f6-4a0e-4f82-b382-45ecedd8150a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.831471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59703ca008a949328897e58718293a90', 'request_id': 'req-f93067f6-4a0e-4f82-b382-45ecedd8150a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.845714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] The token cache is being invalidate because project 59703ca008a949328897e58718293a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:46.846004 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.846673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.848325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1318/2594] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:46 2022] DELETE /identity/v3/projects/59703ca008a949328897e58718293a90 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:46.852416 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:46.853800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.887876 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:46.888560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.888848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.889177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.891146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:46.918356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93067f6-4a0e-4f82-b382-45ecedd8150a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:46.923231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:46.924054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:46.924332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:46.924611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] PATH_INFO: `/v3/users/0807807d8c704cef87739956cbcb5920` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:46.925861 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0807807d8c704cef87739956cbcb5920)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:46.928467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.953589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:46.955310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:46.964928 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1277/2595] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:02:46.980389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0807807d8c704cef87739956cbcb5920'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.987945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0807807d8c704cef87739956cbcb5920'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.996266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0807807d8c704cef87739956cbcb5920'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.997060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0807807d8c704cef87739956cbcb5920'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:46.997777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-ba69ca3f-07f3-48af-9aa6-9beac396ff82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0807807d8c704cef87739956cbcb5920'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.016530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1319/2596] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:46 2022] DELETE /identity/v3/users/0807807d8c704cef87739956cbcb5920 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:47.368338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:47.384879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3908-695e-4c19-9963-040e4df37a87 service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:47.477352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:47.478311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:47.478682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:47.479027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] PATH_INFO: `/v3/projects/3c6a4706e07242bc9b34c2c835667ac5` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:47.480321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6a4706e07242bc9b34c2c835667ac5)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:47.483057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:47.543287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6a4706e07242bc9b34c2c835667ac5', 'request_id': 'req-63cb62d2-c553-42d3-8d75-36e6334cd233'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.549885 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6a4706e07242bc9b34c2c835667ac5', 'request_id': 'req-63cb62d2-c553-42d3-8d75-36e6334cd233'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.560643 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6a4706e07242bc9b34c2c835667ac5', 'request_id': 'req-63cb62d2-c553-42d3-8d75-36e6334cd233'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.578200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] The token cache is being invalidate because project 3c6a4706e07242bc9b34c2c835667ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:47.578521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.579207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-63cb62d2-c553-42d3-8d75-36e6334cd233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:47.580995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1278/2597] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:47 2022] DELETE /identity/v3/projects/3c6a4706e07242bc9b34c2c835667ac5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:47.586131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:47.586519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:47.586868 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:47.607169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:47.609073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:47.741648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1320/2598] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:47.749671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:47.753103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:47.753569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:47.777074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:47.778785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:47.791142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1279/2599] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:47.795468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:47.806148 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cb0a-521d-47db-bb57-bb32ed2755e9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:47.818646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:47.819500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:47.820052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:47.820052 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:47.820850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:47.821166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:47.822849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:47.847115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:47.858192 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d008f7-a40c-4727-9a5a-71fcb5c05041 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:47.859199 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1321/2600] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:02:47.866955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:47.867848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:47.868231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:47.868602 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:47.869501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:47.871599 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:47.903050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1280/2601] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:47 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:47.907295 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:47.920195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57fb4-237b-41d1-a7cb-5d41fa4d3ffd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.024985 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.025727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.026145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.026434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.027179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.029423 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.056059 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1322/2602] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:47 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:48.057439 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.072929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8915-8c16-4006-960b-498c3816922a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.079180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.079909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.080194 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.080483 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.081484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.083205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.098263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1281/2603] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:48.100018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.111194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143a05-72e8-48a3-902a-6da98d2474d4 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.117302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.117975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.118506 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.118740 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.119469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.121082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a725f-12ed-4e54-9159-457c70b80653 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.135664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1323/2604] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:48.138155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.160949 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a1043-ceed-4422-9a97-e2813d510cd9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.175151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.176547 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.177495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.177682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] PATH_INFO: `/v3/projects/eb96807d490f464bb61ee1c3136dfab0/users/de5f34b7896e4c9a8847bbf6fc729f15/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.215316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb96807d490f464bb61ee1c3136dfab0, user_id=de5f34b7896e4c9a8847bbf6fc729f15, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.218005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.236524 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1282/2605] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:48 2022] PUT /identity/v3/projects/eb96807d490f464bb61ee1c3136dfab0/users/de5f34b7896e4c9a8847bbf6fc729f15/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:48.248458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.248458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.248458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.283964 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] MFA Rules not processed for user `de5f34b7896e4c9a8847bbf6fc729f15`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:48.285302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:48.368368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1324/2606] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:48.382061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.383872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:48.445366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafac74-9bae-4e5e-8145-68dc6c21ec3e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.448981 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.449632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.449911 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.450182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.459233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.460657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927ed0c-c509-41ca-b1f8-f6ff6fec6f33 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.469841 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1283/2607] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:48.490884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.572305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82500f-fb73-4d5d-9511-dc4757136a3c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.578580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.579476 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.579764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.580045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] PATH_INFO: `/v3/users/de5f34b7896e4c9a8847bbf6fc729f15` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.581429 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5f34b7896e4c9a8847bbf6fc729f15)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.583892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.632756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5f34b7896e4c9a8847bbf6fc729f15'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:48.639786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5f34b7896e4c9a8847bbf6fc729f15'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:48.648269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5f34b7896e4c9a8847bbf6fc729f15'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:48.649114 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5f34b7896e4c9a8847bbf6fc729f15'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:48.649823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5f34b7896e4c9a8847bbf6fc729f15'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:48.668357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1325/2608] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:48 2022] DELETE /identity/v3/users/de5f34b7896e4c9a8847bbf6fc729f15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:48.673374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.673665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.673942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.691879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:48.693695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:48.757762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1284/2609] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:48.767830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:48.769441 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:48.835566 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56cc0b-4361-4ee4-8158-c8fd4abcb28d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:48.839613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:48.840248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:48.840531 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:48.840804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:48.851315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:48.853252 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20f9b0-7fac-4184-88b9-4516c5ec924d service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:48.867253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1326/2610] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:49.251844 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.253321 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:49.278002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e20d34-f3c7-4bf4-a958-993375d6b8be None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.295623 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.296565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.296920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.297263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] PATH_INFO: `/v3/projects/eb96807d490f464bb61ee1c3136dfab0` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.298763 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb96807d490f464bb61ee1c3136dfab0)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.301210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.365077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb96807d490f464bb61ee1c3136dfab0', 'request_id': 'req-acd4fc40-eb8c-4d5b-9b79-376040be170e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:49.376182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb96807d490f464bb61ee1c3136dfab0', 'request_id': 'req-acd4fc40-eb8c-4d5b-9b79-376040be170e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:49.393793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb96807d490f464bb61ee1c3136dfab0', 'request_id': 'req-acd4fc40-eb8c-4d5b-9b79-376040be170e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:49.415087 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] The token cache is being invalidate because project eb96807d490f464bb61ee1c3136dfab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:49.416796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:49.418296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-acd4fc40-eb8c-4d5b-9b79-376040be170e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:49.423080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1285/2611] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:49 2022] DELETE /identity/v3/projects/eb96807d490f464bb61ee1c3136dfab0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:49.428866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.429174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.429469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.462948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:49.464563 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:49.554511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1327/2612] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:49.563027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.563310 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.563600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.588155 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:49.589688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:49.608470 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1286/2613] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:49.612239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.623487 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901068de-7abd-4d85-be0a-34d832dffa73 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.628955 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.630358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.630885 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.631488 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.632636 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:49.632950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.634603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.650863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1328/2614] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:49.653120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.662904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc6fd-3520-4912-9e2b-b4f3174f40c7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.668175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.669143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.669588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.670022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.670979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.675290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.716541 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1287/2615] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:49 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:49.720874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.731036 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520257d-627c-47e5-97b5-b7f68b4d2c13 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.807156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.807758 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.808057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.808336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.809047 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.811044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.836942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1329/2616] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:49 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:49.838762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.857401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe726d77-c178-4245-b51b-8d50d4cdf690 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.862704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.863382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.863856 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.864188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.865099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.867237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.878780 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1288/2617] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:49.883591 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.894708 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0738b8-2794-421c-a7de-66e3fea4ef28 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.902826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.903822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.904464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.905029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.910970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.913150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eecaf-2e46-4060-85ca-e7d075d09ea5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.924372 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1330/2618] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:02:49.929571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:49.942263 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421394d3-968f-4fbd-a09f-9457086bc2c8 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:49.947827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:49.948722 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.949007 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.949287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] PATH_INFO: `/v3/projects/22e8b5a61eba4b7d8b6d62f09753a273/users/42645c6bc2a14482ba85d20a3e6ceaff/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:49.964695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e8b5a61eba4b7d8b6d62f09753a273, user_id=42645c6bc2a14482ba85d20a3e6ceaff, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:49.968315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:49.982997 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1289/2619] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:49 2022] PUT /identity/v3/projects/22e8b5a61eba4b7d8b6d62f09753a273/users/42645c6bc2a14482ba85d20a3e6ceaff/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:49.995865 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:49.996245 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:49.996520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:50.029950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] MFA Rules not processed for user `42645c6bc2a14482ba85d20a3e6ceaff`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:50.031398 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:50.099707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1331/2620] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:50.110825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:50.112559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:50.172937 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd85d03-324d-422b-a6ab-714518ed3407 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:50.177630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:50.178257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:50.178566 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:50.178846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:50.188305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:50.189875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d020354-4dc4-4b86-afa2-8961a1e6c6bf service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:50.200672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1290/2621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:50.836489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:50.838334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:50.911549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808421-a8f0-48fe-96d0-1d49b0f76155 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:50.916146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:50.917042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:50.917325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:50.917626 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] PATH_INFO: `/v3/users/31f18e79756b45ef92f568d069d515d4` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:50.918912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f18e79756b45ef92f568d069d515d4)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:50.920851 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:50.971368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f18e79756b45ef92f568d069d515d4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:50.980167 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f18e79756b45ef92f568d069d515d4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:50.988080 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f18e79756b45ef92f568d069d515d4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:50.988880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f18e79756b45ef92f568d069d515d4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:50.989595 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f18e79756b45ef92f568d069d515d4'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.009768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1332/2622] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:50 2022] DELETE /identity/v3/users/31f18e79756b45ef92f568d069d515d4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:51.014232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548554e2-310d-4369-84fe-11397820953a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:51.015933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548554e2-310d-4369-84fe-11397820953a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:51.016358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548554e2-310d-4369-84fe-11397820953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:51.034630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-548554e2-310d-4369-84fe-11397820953a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:51.035952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-548554e2-310d-4369-84fe-11397820953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:51.100386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1291/2623] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:51.110806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:51.112241 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:51.178156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dcbdb-0815-466a-ae52-0b09a5d66429 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:51.181745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:51.182391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:51.182709 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:51.182988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:51.192879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:51.194294 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:51.208912 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1333/2624] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:51.539476 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548554e2-310d-4369-84fe-11397820953a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:51.542062 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-548554e2-310d-4369-84fe-11397820953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:51.566131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548554e2-310d-4369-84fe-11397820953a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:51.579953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:51.581244 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:51.582305 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:51.582671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] PATH_INFO: `/v3/projects/b40669ae3197401499f50c4da1f12d60` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:51.584158 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40669ae3197401499f50c4da1f12d60)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:51.586186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:51.638673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40669ae3197401499f50c4da1f12d60', 'request_id': 'req-8c7ac2e5-e841-41f0-af5f-122a46ad9110'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.645713 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40669ae3197401499f50c4da1f12d60', 'request_id': 'req-8c7ac2e5-e841-41f0-af5f-122a46ad9110'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.655670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40669ae3197401499f50c4da1f12d60', 'request_id': 'req-8c7ac2e5-e841-41f0-af5f-122a46ad9110'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.668660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] The token cache is being invalidate because project b40669ae3197401499f50c4da1f12d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:51.668953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.669649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.671241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1292/2625] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:51 2022] DELETE /identity/v3/projects/b40669ae3197401499f50c4da1f12d60 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:51.675226 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:51.685826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7a2e2-fd39-47b7-a167-c5a98d43602b service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:51.759356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:51.760301 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:51.760674 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:51.761016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] PATH_INFO: `/v3/users/9aa87457778d449fb2512dfae6543e19` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:51.762335 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa87457778d449fb2512dfae6543e19)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:51.764383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:51.845058 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa87457778d449fb2512dfae6543e19'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.852233 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa87457778d449fb2512dfae6543e19'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.861437 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa87457778d449fb2512dfae6543e19'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.862067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa87457778d449fb2512dfae6543e19'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.862819 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa87457778d449fb2512dfae6543e19'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:51.883811 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1334/2626] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:51 2022] DELETE /identity/v3/users/9aa87457778d449fb2512dfae6543e19 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:52.270999 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:52.276214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:52.321697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ac2e5-e841-41f0-af5f-122a46ad9110 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:52.414195 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:52.415177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:52.415570 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:52.415846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] PATH_INFO: `/v3/projects/2b19f4b6934f455a873e5b167871be1f` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:52.417303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b19f4b6934f455a873e5b167871be1f)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:52.419301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:52.477784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b19f4b6934f455a873e5b167871be1f', 'request_id': 'req-246be973-3836-4f2a-adab-d764ce7ef6f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.484938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b19f4b6934f455a873e5b167871be1f', 'request_id': 'req-246be973-3836-4f2a-adab-d764ce7ef6f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.500123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b19f4b6934f455a873e5b167871be1f', 'request_id': 'req-246be973-3836-4f2a-adab-d764ce7ef6f2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.511819 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] The token cache is being invalidate because project 2b19f4b6934f455a873e5b167871be1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:52.512105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.512760 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.514832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1293/2627] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:52 2022] DELETE /identity/v3/projects/2b19f4b6934f455a873e5b167871be1f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:52.519050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:52.521240 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:52.535775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16101-2de1-42df-8f5f-b3f924a357f8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:52.601123 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:52.602019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:52.602303 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:52.602676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] PATH_INFO: `/v3/users/0903530b1d3c408f8f316b62c1874897` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:52.603938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0903530b1d3c408f8f316b62c1874897)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:52.606098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:52.675212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0903530b1d3c408f8f316b62c1874897'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.683751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0903530b1d3c408f8f316b62c1874897'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.694781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0903530b1d3c408f8f316b62c1874897'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.695131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0903530b1d3c408f8f316b62c1874897'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.695886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-6bbcca22-07ea-48b9-9416-6fedd9144792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0903530b1d3c408f8f316b62c1874897'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:52.715938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1335/2628] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:02:52 2022] DELETE /identity/v3/users/0903530b1d3c408f8f316b62c1874897 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:02:53.029696 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.031341 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:53.045140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be973-3836-4f2a-adab-d764ce7ef6f2 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.107518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.108382 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.108664 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.108946 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] PATH_INFO: `/v3/projects/8d7124941c764f808bd88eec124c068a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.110148 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7124941c764f808bd88eec124c068a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.112094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.163050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7124941c764f808bd88eec124c068a', 'request_id': 'req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:53.169840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7124941c764f808bd88eec124c068a', 'request_id': 'req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:53.178451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7124941c764f808bd88eec124c068a', 'request_id': 'req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:53.192517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] The token cache is being invalidate because project 8d7124941c764f808bd88eec124c068a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:02:53.192902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:53.193572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-336e51b1-51b3-4b76-bedc-d0c4bfef21cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:02:53.195374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1294/2629] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:02:53 2022] DELETE /identity/v3/projects/8d7124941c764f808bd88eec124c068a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:53.200379 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.200894 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.201014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.221315 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:53.222542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:53.290511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1336/2630] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:53.298346 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.298932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.299056 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.318207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:53.319441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:53.327929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1295/2631] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:02:53.332383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.342432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b33d4-716e-4d1f-9eb4-bdb402cc5d97 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.362297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.363022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.363311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.363596 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.364953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:02:53.365280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.367214 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.382427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1337/2632] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:02:53.387455 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.398215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e036c-c8f6-4c70-808b-d6b798cd3569 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.407266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.408048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.408429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.408904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.409688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.422969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.460237 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1296/2633] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:02:53 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:02:53.461019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.472420 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82b94c-8658-4818-a54b-6cd11074e8da admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.558480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.559201 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.559489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.559775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.560508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.562760 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.588987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1338/2634] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:02:53 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:02:53.592868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.612329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f5c5c-c850-44fc-ba5a-eb6511c7af43 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.619201 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.620266 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.620548 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.620825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.621558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.623198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.634809 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1297/2635] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:53.639005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.650216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2790-5b6f-4ed5-9e71-152d70bf6a34 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.655071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.655746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.656035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.656368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.657195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.658874 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313ad7-8b4d-48d8-b220-a3e19bbcac3a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.670041 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1339/2636] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:02:53.674660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.685598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cd633-f271-4aed-bbc9-f9efac9b0b72 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.690432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.691344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.691625 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.691898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] PATH_INFO: `/v3/projects/6c4cc9869de147a982a14d99fe61bced/users/0d9aaa8277644382a0ac82f2f3d58db3/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.709681 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4cc9869de147a982a14d99fe61bced, user_id=0d9aaa8277644382a0ac82f2f3d58db3, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.712687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.726174 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1298/2637] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:02:53 2022] PUT /identity/v3/projects/6c4cc9869de147a982a14d99fe61bced/users/0d9aaa8277644382a0ac82f2f3d58db3/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:02:53.731857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d4e1-4fdf-44d4-b426-f028d69fbaea None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.732224 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d4e1-4fdf-44d4-b426-f028d69fbaea None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.732582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d4e1-4fdf-44d4-b426-f028d69fbaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.754915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8f53d4e1-4fdf-44d4-b426-f028d69fbaea None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:53.756853 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8f53d4e1-4fdf-44d4-b426-f028d69fbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:53.838388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1340/2638] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:53.849519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:53.859991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:53.938853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7616f8b-1ba5-4220-9ddb-bdcbdc507b0e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:53.943205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:53.943765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:53.944257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:53.944746 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:53.958878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:53.960560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:53.971772 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1299/2639] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:54.911989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327dde5-900d-4d97-99d9-1301b54d7daa None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:54.912560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327dde5-900d-4d97-99d9-1301b54d7daa None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:54.912560 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327dde5-900d-4d97-99d9-1301b54d7daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:54.969033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c327dde5-900d-4d97-99d9-1301b54d7daa None None] MFA Rules not processed for user `0d9aaa8277644382a0ac82f2f3d58db3`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:54.970548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c327dde5-900d-4d97-99d9-1301b54d7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:55.066412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1341/2640] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:02:55.083879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:02:55.085438 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:55.153533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412afbcf-2a5c-4952-8599-dda5e0ddd744 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:02:55.158190 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:02:55.158957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:55.159268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:55.159651 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:55.171339 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:02:55.172782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f21cb-0592-425e-9a51-30324c83e2fc service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:02:55.185952 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1300/2641] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:02:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:02:56.518094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:02:56.518632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:02:56.518732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:02:56.537104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] MFA Rules not processed for user `0d9aaa8277644382a0ac82f2f3d58db3`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:02:56.538309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:02:56.545265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1342/2642] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:07.154145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16261-9439-4604-b945-2bfd5f52d53f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:07.154766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16261-9439-4604-b945-2bfd5f52d53f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:07.154873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16261-9439-4604-b945-2bfd5f52d53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:07.173410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-63a16261-9439-4604-b945-2bfd5f52d53f None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:07.174669 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-63a16261-9439-4604-b945-2bfd5f52d53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:07.247908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1301/2643] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:03:07.261369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:07.262982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:07.335623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd2a75-5295-4923-a75b-e7824a95fe3c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:07.341143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:07.341799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:07.342186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:07.342356 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:07.351643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:07.353255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:07.363166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1343/2644] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:03:13.879368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8615dc-be99-4a8d-bae2-bbaf455e905d None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:13.879892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8615dc-be99-4a8d-bae2-bbaf455e905d None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:13.880001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8615dc-be99-4a8d-bae2-bbaf455e905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:13.898668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6d8615dc-be99-4a8d-bae2-bbaf455e905d None None] MFA Rules not processed for user `0d9aaa8277644382a0ac82f2f3d58db3`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:13.899866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6d8615dc-be99-4a8d-bae2-bbaf455e905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:13.906818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1302/2645] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:26.504948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:26.506924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:26.520139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2df0-f820-4a81-9d2c-c5a857ec669f service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:26.527131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:26.528002 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:26.528289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:26.528569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] PATH_INFO: `/v3/users/42645c6bc2a14482ba85d20a3e6ceaff` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:26.529774 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42645c6bc2a14482ba85d20a3e6ceaff)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:26.531772 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:26.578652 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42645c6bc2a14482ba85d20a3e6ceaff'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:26.585228 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42645c6bc2a14482ba85d20a3e6ceaff'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:26.592743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42645c6bc2a14482ba85d20a3e6ceaff'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:26.593482 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42645c6bc2a14482ba85d20a3e6ceaff'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:26.594105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42645c6bc2a14482ba85d20a3e6ceaff'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:26.614021 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1344/2646] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:03:26 2022] DELETE /identity/v3/users/42645c6bc2a14482ba85d20a3e6ceaff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:03:26.619008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:26.619674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:26.619674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:26.640125 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:26.641334 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:26.710903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1303/2647] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:26.720457 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:26.721903 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:26.778085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a323b0-3f99-4ad9-a98f-8f81436554d8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:26.781561 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:26.782191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:26.782499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:26.782780 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:26.792094 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:26.793512 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9a814-e933-47ef-adbd-3503d3d1ed95 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:26.802686 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1345/2648] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:03:27.054000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.055545 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:27.068765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c723f-4b41-467f-b25d-02f7b2d7d71b None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.073572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.074668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.075011 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.075410 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] PATH_INFO: `/v3/projects/22e8b5a61eba4b7d8b6d62f09753a273` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.076676 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e8b5a61eba4b7d8b6d62f09753a273)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.078693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.127835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e8b5a61eba4b7d8b6d62f09753a273', 'request_id': 'req-15e314b7-0276-4837-914a-b944c145fd7a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:27.133938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e8b5a61eba4b7d8b6d62f09753a273', 'request_id': 'req-15e314b7-0276-4837-914a-b944c145fd7a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:27.141185 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e8b5a61eba4b7d8b6d62f09753a273', 'request_id': 'req-15e314b7-0276-4837-914a-b944c145fd7a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:27.151105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] The token cache is being invalidate because project 22e8b5a61eba4b7d8b6d62f09753a273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:03:27.151392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:27.152018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-15e314b7-0276-4837-914a-b944c145fd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:27.153597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1304/2649] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:03:27 2022] DELETE /identity/v3/projects/22e8b5a61eba4b7d8b6d62f09753a273 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:03:27.158875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.159284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.159549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.177925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:27.179089 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:27.236823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1346/2650] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:27.245963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.246247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.246558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.265122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:27.266329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:27.275260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1305/2651] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:03:27.279388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.288927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536034-886d-495a-b5c1-6696ddb70943 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.293507 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.294151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.294438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.294759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.295479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:03:27.295841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.297386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.309532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1347/2652] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:03:27.313620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.323364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8827ed-c295-45d9-bbe1-f6e109a6265e None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.328053 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.328689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.328977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.329255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.329955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.331898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.357002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1306/2653] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:03:27.361525 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.374298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d14dd-c515-42c8-b383-a224689fb4f6 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.429627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.430289 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.430608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.430887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.431578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.433489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.451879 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1348/2654] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:03:27 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:03:27.455938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.465917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856cfd-e527-4197-b8a0-c1d48af168bd admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.470412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.471083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.471362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.471649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.472348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.473996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.483976 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1307/2655] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:03:27.487822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.498298 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55176d59-ca2b-4600-a8d6-e88f806be5cd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.502992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.503639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.503927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.504209 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.504933 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.507131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bbb10-b278-4b9e-a08f-4999654351e3 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.516662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1349/2656] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:03:27.520583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.530970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225bea-4859-4483-bc0b-981b9ce48f96 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.535758 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.536789 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.537165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.537450 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] PATH_INFO: `/v3/projects/143c50428b1247a9ac6f60a26bfbaa80/users/4ed6cd976b1442718a7b307588b57431/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.553253 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143c50428b1247a9ac6f60a26bfbaa80, user_id=4ed6cd976b1442718a7b307588b57431, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.555927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.569808 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1308/2657] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:03:27 2022] PUT /identity/v3/projects/143c50428b1247a9ac6f60a26bfbaa80/users/4ed6cd976b1442718a7b307588b57431/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:03:27.574866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb2e1-80f8-4ebb-9ea6-05aabeb6ee3a None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.575156 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb2e1-80f8-4ebb-9ea6-05aabeb6ee3a None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.575433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deb2e1-80f8-4ebb-9ea6-05aabeb6ee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.592707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-78deb2e1-80f8-4ebb-9ea6-05aabeb6ee3a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:27.593884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-78deb2e1-80f8-4ebb-9ea6-05aabeb6ee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:27.649721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1350/2658] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:27.659356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:27.661061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:27.717254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ea7ca-cf55-4731-a826-a154b8e78560 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:27.720934 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:27.721639 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:27.721931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:27.722213 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:27.732848 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:27.734130 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:27.744560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1309/2659] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:03:28.371637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ebe6f-99b6-4b1f-ba0b-65dcea0b18de None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:28.372009 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ebe6f-99b6-4b1f-ba0b-65dcea0b18de None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:28.372297 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ebe6f-99b6-4b1f-ba0b-65dcea0b18de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:28.402717 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-594ebe6f-99b6-4b1f-ba0b-65dcea0b18de None None] MFA Rules not processed for user `4ed6cd976b1442718a7b307588b57431`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:28.403944 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-594ebe6f-99b6-4b1f-ba0b-65dcea0b18de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:28.476464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1351/2660] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:28.489505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:28.491221 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:28.551596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c97f5-4a25-48af-9395-a6e3154edc93 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:28.555418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:28.556098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:28.556381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:28.556658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:28.565080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:28.566557 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878f1eb-339e-40eb-8409-3967b00149ed service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:28.575805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1310/2661] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:03:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:03:31.996499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:31.996997 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:31.997115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:32.014828 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] MFA Rules not processed for user `4ed6cd976b1442718a7b307588b57431`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:32.016019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:32.023458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1352/2662] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:32.401608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c7fd-24a9-4566-98cc-3e34300dc75f None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:32.402109 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c7fd-24a9-4566-98cc-3e34300dc75f None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:32.402230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c7fd-24a9-4566-98cc-3e34300dc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:32.420560 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-45c9c7fd-24a9-4566-98cc-3e34300dc75f None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:32.421781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-45c9c7fd-24a9-4566-98cc-3e34300dc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:32.476791 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1311/2663] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:32.502149 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:32.503726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:32.596570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4406ce-a3dd-4036-b98d-8bd684a466a3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:32.602503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:32.603900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:32.604257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:32.604610 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:32.614320 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:32.616779 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b6b9-46b4-4316-84c2-98b468731352 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:32.627045 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1353/2664] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:03:50.186936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:50.187461 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:50.187577 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:50.205300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] MFA Rules not processed for user `be0ebfb74d254359b4dfa36d9aff4ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:50.206515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:50.260712 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1312/2665] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:51.228703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:51.229220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:51.229318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:51.250694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:51.251939 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:51.265907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1354/2666] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:51.273649 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:51.286159 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d862a68-0e8c-4371-bffb-f20d415d03f6 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:51.292793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:51.294046 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:51.294554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:51.295016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:51.305368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:51.308424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:51.317933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1313/2667] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:03:53.291754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:53.294800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:53.315886 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a441a-fbdb-422b-8a2f-8b26052b0448 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:53.324812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:53.325908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:53.326229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:53.326578 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] PATH_INFO: `/v3/users/0d9aaa8277644382a0ac82f2f3d58db3` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:53.331572 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9aaa8277644382a0ac82f2f3d58db3)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:53.334253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:53.392203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9aaa8277644382a0ac82f2f3d58db3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.399793 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9aaa8277644382a0ac82f2f3d58db3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.407857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9aaa8277644382a0ac82f2f3d58db3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.408710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9aaa8277644382a0ac82f2f3d58db3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.409461 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-519f9aca-34a7-41ae-aba3-743643fde22a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9aaa8277644382a0ac82f2f3d58db3'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.440518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1355/2668] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:03:53 2022] DELETE /identity/v3/users/0d9aaa8277644382a0ac82f2f3d58db3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:03:53.664376 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:53.680271 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde0191-c081-4920-beb6-7be530013b80 service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:53.743288 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:53.744162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:53.744494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:53.744777 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] PATH_INFO: `/v3/projects/6c4cc9869de147a982a14d99fe61bced` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:53.746101 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4cc9869de147a982a14d99fe61bced)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:53.748115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:53.796916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4cc9869de147a982a14d99fe61bced', 'request_id': 'req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.804292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4cc9869de147a982a14d99fe61bced', 'request_id': 'req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.813057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4cc9869de147a982a14d99fe61bced', 'request_id': 'req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.823749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] The token cache is being invalidate because project 6c4cc9869de147a982a14d99fe61bced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:03:53.824030 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.824728 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-b5e190bf-657e-4b4b-a0d7-3ad9f037b119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:03:53.826356 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1314/2669] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:03:53 2022] DELETE /identity/v3/projects/6c4cc9869de147a982a14d99fe61bced => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:03:53.831613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:53.831925 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:53.832278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:53.851253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:53.853124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:53.929256 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1356/2670] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:53.931996 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:53.932282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:53.932558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:53.952958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:53.955208 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:53.981363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1315/2671] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:53.985732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:53.997250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd1fc6-0f45-4888-8114-ba5ad17ed3af None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.002650 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.003597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.004042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.004724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.005611 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:03:54.006143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.007970 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.024889 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1357/2672] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:03:54.025615 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.036411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c747974-349c-4862-9632-ce7552bb5bbd None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.045464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.046140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.046428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.046745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.047495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.050369 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.080300 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1316/2673] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:03:54 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:03:54.084318 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.096099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa7f-718d-4a92-8b24-ef99332934a8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.168845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.169440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.169788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.170073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.170804 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.172849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.200279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1358/2674] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:03:54 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:03:54.201531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.213260 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24cb98-8687-4351-ae95-da01ecd07625 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.220051 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.220830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.221182 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.221527 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.222333 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.224047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.238479 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1317/2675] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:03:54.239987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.250432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe767-4f8f-4047-9d54-888bacb58b1a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.256368 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.257067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.257439 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.257937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.258731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.260361 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9636e-b938-4e09-a53a-0b5e8e02e741 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.275496 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1359/2676] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:03:54.276840 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.286867 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1abc3-1c99-468a-a7c5-c92134247a7a admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.295473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.296385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.296672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.296950 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] PATH_INFO: `/v3/projects/7812c5045988421aa82845f73e66b2a1/users/274e6e1e975f45ad92a18f88094b414a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.315542 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7812c5045988421aa82845f73e66b2a1, user_id=274e6e1e975f45ad92a18f88094b414a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.321927 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.345538 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1318/2677] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:03:54 2022] PUT /identity/v3/projects/7812c5045988421aa82845f73e66b2a1/users/274e6e1e975f45ad92a18f88094b414a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:03:54.355776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012289ed-0354-4abc-a39b-fdbdbc9b515e None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.356325 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012289ed-0354-4abc-a39b-fdbdbc9b515e None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.356456 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012289ed-0354-4abc-a39b-fdbdbc9b515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.388691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-012289ed-0354-4abc-a39b-fdbdbc9b515e None None] MFA Rules not processed for user `274e6e1e975f45ad92a18f88094b414a`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:54.390161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-012289ed-0354-4abc-a39b-fdbdbc9b515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:54.461660 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1360/2678] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:03:54.475670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:54.478096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:54.547029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2522b6-b226-4069-9a25-2a9fb91587a9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:54.550658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:54.551314 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:54.551595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:54.551869 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:54.560558 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:54.561939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:54.575721 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1319/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:03:55.995111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68296-30de-4200-a0e0-002e1246831d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:55.995606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68296-30de-4200-a0e0-002e1246831d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:55.995698 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68296-30de-4200-a0e0-002e1246831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:56.017594 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-e8f68296-30de-4200-a0e0-002e1246831d None None] MFA Rules not processed for user `274e6e1e975f45ad92a18f88094b414a`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:56.019360 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e8f68296-30de-4200-a0e0-002e1246831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:56.032567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1361/2680] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:03:58.024539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:03:58.026805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:58.113419 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aba0df-4f8d-4401-b3b1-66ad4b77a77d service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:03:58.119499 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:03:58.120501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:58.120782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:58.121232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:58.123072 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:58.193507 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:03:58.194675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:03:58.205069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1320/2681] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:03:58.644173 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:03:58.644664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:03:58.644941 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:03:58.663181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] MFA Rules not processed for user `56653f5922984dde83b35ba154e97bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:03:58.664648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:03:58.725354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1362/2682] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:17.058183 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:17.059766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:17.074727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f743a8-88b3-4131-b089-5b06dbe8555e service nova] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:17.080219 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:17.080858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:17.081141 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:17.081420 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:17.083207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:17.095331 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:17.096901 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206cb4b-287d-4ecb-b13f-92bb0dbbf3d0 service nova] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:17.107504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1321/2683] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:04:19.413556 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:19.415146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:19.495248 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7860a6-ac72-4cee-9f48-427158abfb82 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:19.500211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:19.500914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:19.501202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:19.501479 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:19.503250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:19.516068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:19.518192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:19.532762 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1363/2684] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:04:23.765434 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bfa0-d414-4bb3-b218-48ee7d572795 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:23.765926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bfa0-d414-4bb3-b218-48ee7d572795 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:23.765926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bfa0-d414-4bb3-b218-48ee7d572795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:23.783160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0729bfa0-d414-4bb3-b218-48ee7d572795 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:23.784323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0729bfa0-d414-4bb3-b218-48ee7d572795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:23.841389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1322/2685] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:23.853251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:23.854712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:23.924391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a43a7-8b4e-4ea8-9d9a-68f860387884 service placement] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:23.930501 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:23.931182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:23.931471 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:23.931752 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:23.939777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:23.941370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:23.949910 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1364/2686] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:04:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:04:24.446351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7c5a-dbb6-404d-bdb6-25f72202b1f3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:24.446674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7c5a-dbb6-404d-bdb6-25f72202b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:24.446953 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7c5a-dbb6-404d-bdb6-25f72202b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:24.464707 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-789a7c5a-dbb6-404d-bdb6-25f72202b1f3 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:24.465930 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-789a7c5a-dbb6-404d-bdb6-25f72202b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:24.474140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1323/2687] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:24.486141 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:24.497244 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822db1-8a49-4385-b808-955d0d282ee1 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:24.502277 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:24.502949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:24.503239 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:24.503521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:24.512111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:24.513688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:24.521777 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1365/2688] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:04:24.705054 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b077-8354-469a-975f-7878ecd0a9b4 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:24.705352 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b077-8354-469a-975f-7878ecd0a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:24.705673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b077-8354-469a-975f-7878ecd0a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:24.723896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-67b4b077-8354-469a-975f-7878ecd0a9b4 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:24.725971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-67b4b077-8354-469a-975f-7878ecd0a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:24.732931 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1324/2689] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:24.745443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:24.755728 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3593a4-db9c-47b9-9999-a67f0263ca08 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:24.760683 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:24.761309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:24.761593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:24.761869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:24.769897 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:24.771338 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:24.779509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1366/2690] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:04:25.099274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:25.099752 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:25.099860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:25.118485 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:25.119688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:25.126764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1325/2691] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:25.139231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:25.150267 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fad58-8668-4218-8dc9-e928ef2ebac2 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:25.155290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:25.155978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:25.156263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:25.156644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:25.166896 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:25.168481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3923b-2cc6-4781-adc1-1d1c00c8105f service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:25.176389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1367/2692] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:04:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:04:27.268281 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:27.337857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdad41-7eb6-4d54-ac2a-4bffbc31a014 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:27.342225 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:27.343117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.343401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.343675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] PATH_INFO: `/v3/users/274e6e1e975f45ad92a18f88094b414a` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.344835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274e6e1e975f45ad92a18f88094b414a)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:27.347298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:27.392832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274e6e1e975f45ad92a18f88094b414a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.399489 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274e6e1e975f45ad92a18f88094b414a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.400175 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274e6e1e975f45ad92a18f88094b414a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.411627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274e6e1e975f45ad92a18f88094b414a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.412275 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274e6e1e975f45ad92a18f88094b414a'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.424630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1326/2693] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:04:27 2022] DELETE /identity/v3/users/274e6e1e975f45ad92a18f88094b414a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:04:27.429581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.430119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.430119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.447755 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:27.448954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:27.507524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1368/2694] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:27.516287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:27.517749 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:27.573604 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e9c1-480a-4909-8282-751d00d34684 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:27.577189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:27.577829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.578107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.578383 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.587060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:27.588554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1f6b5-ba1c-4267-95be-6f29e874fb70 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:27.597624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1327/2695] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:04:27.767408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:27.769283 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:27.781346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be47f2-2b70-4bde-872e-edde1c6e31d7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:27.787523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:27.788983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.789443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.789727 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] PATH_INFO: `/v3/projects/7812c5045988421aa82845f73e66b2a1` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.791130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7812c5045988421aa82845f73e66b2a1)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:27.793085 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:27.841235 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7812c5045988421aa82845f73e66b2a1', 'request_id': 'req-b98076a5-773f-4344-8845-c6e55f238669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.847163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7812c5045988421aa82845f73e66b2a1', 'request_id': 'req-b98076a5-773f-4344-8845-c6e55f238669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.852981 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7812c5045988421aa82845f73e66b2a1', 'request_id': 'req-b98076a5-773f-4344-8845-c6e55f238669'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.865006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] The token cache is being invalidate because project 7812c5045988421aa82845f73e66b2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:04:27.865314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.865966 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b98076a5-773f-4344-8845-c6e55f238669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:27.868143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1369/2696] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:04:27 2022] DELETE /identity/v3/projects/7812c5045988421aa82845f73e66b2a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:04:27.873105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.873386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.873658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.890970 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:27.892200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:27.955703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1328/2697] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:27.963733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:27.964024 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:27.964337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:27.983464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:27.984664 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:27.993565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1370/2698] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:27.997793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.009247 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffe299-8058-47ac-a91e-6273842e50df None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.014444 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.015063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.015350 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.015631 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.016357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:04:28.016670 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.018268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.030539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1329/2699] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:04:28.034841 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.044520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13700b-dfad-4a83-a66f-3d80b791e767 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.056716 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.057406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.057693 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.057968 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.058692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.060608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.086206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1371/2700] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:04:28 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:04:28.090152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.099948 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc716-1a6a-4e81-8e19-1f49e781f4bf admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.155683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.156354 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.156640 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.157059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.158146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.160652 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.181506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1330/2701] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:04:28 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:04:28.185450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.195582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b2f0d-664a-449a-960c-10a6889ed428 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.200220 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.200875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.201163 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.201443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.202162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.203818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.214856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1372/2702] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:04:28.218706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.229613 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660433-a470-4e52-8ef0-fe5217c9a40d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.234166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.234858 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.235160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.235424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.236149 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.237743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9baa-722b-458a-a2ed-de14a1239778 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.248462 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1331/2703] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:04:28.252590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.262642 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656edbc5-e1ee-49f2-aa1a-88978c5d5456 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.269691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.269691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.269691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.269691 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] PATH_INFO: `/v3/projects/9c35976ca7ab470c9d326233c584b267/users/8f968e36ebad439b939edb7dbddf0f1f/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.286005 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c35976ca7ab470c9d326233c584b267, user_id=8f968e36ebad439b939edb7dbddf0f1f, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.289390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.303418 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1373/2704] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:04:28 2022] PUT /identity/v3/projects/9c35976ca7ab470c9d326233c584b267/users/8f968e36ebad439b939edb7dbddf0f1f/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:04:28.314523 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.315103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.315103 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.342170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] MFA Rules not processed for user `8f968e36ebad439b939edb7dbddf0f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:28.343427 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:28.412343 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1332/2705] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:28.424703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:28.426393 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:28.484582 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc336c-520c-418a-807e-dc926d0aad85 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:28.488401 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:28.489308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:28.489593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:28.489883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:28.498215 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:28.499712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a75ab-30ee-4924-b908-1cf2ab3b3ddc service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:28.509784 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1374/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:04:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:04:39.779003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:39.847702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96333c1-47ec-4b8f-9430-5bab664c4370 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:39.852365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:39.853224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:39.853510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:39.853790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] PATH_INFO: `/v3/users/8f968e36ebad439b939edb7dbddf0f1f` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:39.855016 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f968e36ebad439b939edb7dbddf0f1f)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:39.856935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:39.904725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f968e36ebad439b939edb7dbddf0f1f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:39.911363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f968e36ebad439b939edb7dbddf0f1f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:39.912022 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f968e36ebad439b939edb7dbddf0f1f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:39.923220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f968e36ebad439b939edb7dbddf0f1f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:39.923849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f968e36ebad439b939edb7dbddf0f1f'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:39.936673 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1333/2707] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:04:39 2022] DELETE /identity/v3/users/8f968e36ebad439b939edb7dbddf0f1f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:04:39.941395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6275-871d-457c-b458-577a826dca9b None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:39.941900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6275-871d-457c-b458-577a826dca9b None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:39.942023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6275-871d-457c-b458-577a826dca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:39.959108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-d36f6275-871d-457c-b458-577a826dca9b None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:39.960336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d36f6275-871d-457c-b458-577a826dca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:40.016873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1375/2708] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:04:40.026568 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:40.027957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:40.083879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be575d-c13a-48ba-b41a-8484fadd2a2d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:40.087484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:40.088124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:40.088409 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:40.088689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:40.097478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:40.098947 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad64f7-6597-49fa-a9d3-b3ab7fbb8f7c service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:40.108665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1334/2709] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:04:40.363292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f6275-871d-457c-b458-577a826dca9b None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:04:40.365326 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d36f6275-871d-457c-b458-577a826dca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:40.377382 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f6275-871d-457c-b458-577a826dca9b None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:04:40.382679 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:04:40.383696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:40.383982 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:40.384253 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] PATH_INFO: `/v3/projects/9c35976ca7ab470c9d326233c584b267` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:40.385438 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c35976ca7ab470c9d326233c584b267)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:04:40.387383 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:04:40.434078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c35976ca7ab470c9d326233c584b267', 'request_id': 'req-f89e15db-1aec-4603-9230-19b9c3eb7582'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:40.440118 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c35976ca7ab470c9d326233c584b267', 'request_id': 'req-f89e15db-1aec-4603-9230-19b9c3eb7582'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:40.446278 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c35976ca7ab470c9d326233c584b267', 'request_id': 'req-f89e15db-1aec-4603-9230-19b9c3eb7582'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:40.459600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] The token cache is being invalidate because project 9c35976ca7ab470c9d326233c584b267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:04:40.459895 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:40.460516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f89e15db-1aec-4603-9230-19b9c3eb7582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:04:40.462068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1376/2710] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:04:40 2022] DELETE /identity/v3/projects/9c35976ca7ab470c9d326233c584b267 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:04:43.810067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:04:43.810567 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:04:43.810684 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:04:43.827368 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] MFA Rules not processed for user `4ed6cd976b1442718a7b307588b57431`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:04:43.828569 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:04:43.880902 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1335/2711] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:04:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:25.475095 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1ade-ccac-4a01-8079-7adbd2d995bf None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:25.475724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1ade-ccac-4a01-8079-7adbd2d995bf None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:25.475724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1ade-ccac-4a01-8079-7adbd2d995bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:25.495334 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-904b1ade-ccac-4a01-8079-7adbd2d995bf None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:25.496545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-904b1ade-ccac-4a01-8079-7adbd2d995bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:25.553869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1377/2712] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:05:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:25.600224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:25.601640 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:25.672586 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b64c1-430b-4c87-93f7-fc7f02e8f77c None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:25.677587 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:25.678357 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:25.678682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:25.678964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:25.687913 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:25.689535 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:25.697821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1336/2713] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:05:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:05:40.380645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:40.381121 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:40.381434 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:40.400176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:40.401374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:40.408887 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1378/2714] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:05:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:40.420782 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:40.431301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3a718-f939-4223-aff9-35d42aa01691 service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:40.436879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:40.437505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:40.437793 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:40.438074 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:40.446537 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:40.448117 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:40.456621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1337/2715] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:05:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:05:41.972834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:41.974362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:42.050251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118452-a4c0-416e-bb07-b4cece4b2464 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.055049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:42.055924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.056238 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.056518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] PATH_INFO: `/v3/users/4ed6cd976b1442718a7b307588b57431` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.057732 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed6cd976b1442718a7b307588b57431)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:42.060269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:42.113185 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed6cd976b1442718a7b307588b57431'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.120263 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed6cd976b1442718a7b307588b57431'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.128963 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed6cd976b1442718a7b307588b57431'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.130103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed6cd976b1442718a7b307588b57431'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.130818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-a538e398-9433-4139-b9cf-a954afa10ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed6cd976b1442718a7b307588b57431'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.152014 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1379/2716] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:05:41 2022] DELETE /identity/v3/users/4ed6cd976b1442718a7b307588b57431 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:05:42.421296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:42.444222 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527552f-6c92-457c-ad9d-f1cb8872051c service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.540303 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:42.541374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.541657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.541932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] PATH_INFO: `/v3/projects/143c50428b1247a9ac6f60a26bfbaa80` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.543198 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143c50428b1247a9ac6f60a26bfbaa80)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:42.545110 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:42.608805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143c50428b1247a9ac6f60a26bfbaa80', 'request_id': 'req-97aacd09-a692-4b0c-a6d3-3bdf862099d8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.615401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143c50428b1247a9ac6f60a26bfbaa80', 'request_id': 'req-97aacd09-a692-4b0c-a6d3-3bdf862099d8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.623903 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143c50428b1247a9ac6f60a26bfbaa80', 'request_id': 'req-97aacd09-a692-4b0c-a6d3-3bdf862099d8'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.634632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] The token cache is being invalidate because project 143c50428b1247a9ac6f60a26bfbaa80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:05:42.634918 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.635609 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-97aacd09-a692-4b0c-a6d3-3bdf862099d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:05:42.637956 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1338/2717] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:05:42 2022] DELETE /identity/v3/projects/143c50428b1247a9ac6f60a26bfbaa80 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:05:42.643067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.643366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.643651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.661477 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:42.662651 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:42.724412 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1380/2718] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:05:42.734517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.734517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.734517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.754992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:42.756456 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:42.766807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1339/2719] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:42.770646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:42.782347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d432e-b968-4804-b9b5-cea30db0f291 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.787834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:42.788825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.789137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.789417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.790152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:05:42.790489 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:42.792139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:42.806281 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1381/2720] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:05:42.810938 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:42.826787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834392-b038-4685-9af0-cb8af6d7ab6a None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.833695 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:42.834805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.835250 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.835571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.836344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:42.838386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:42.870018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1340/2721] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:05:42 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:05:42.870928 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:42.881639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171c56-0a48-49d7-926e-58fb902494d1 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.950545 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:42.951251 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:42.951541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:42.951825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:42.952519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:42.954503 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:42.978314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1382/2722] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:05:42 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:05:42.979506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:42.991965 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf996144-9b37-4fc3-8a08-045dd8839719 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:42.999191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:43.000067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:43.000555 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:43.000896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:43.001833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:43.003790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:43.015012 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1341/2723] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:05:43.018973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:43.029469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52af33-6b9e-4981-8e0c-1ad421dd0076 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:43.035012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:43.035839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:43.036130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:43.036478 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:43.037269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:43.038938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f57b6-f120-497b-b750-1fb8153b4450 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:43.050764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1383/2724] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:05:43.055108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:43.067752 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e6b5e-022d-4a4a-bcc6-d63c73bfdf91 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:43.072790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:43.074257 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:43.074785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:43.075068 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] PATH_INFO: `/v3/projects/4d8820e6b7a04ca89202e7b7ed991f9a/users/48870723aed043be9db4f5923a05e8c2/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:43.094078 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8820e6b7a04ca89202e7b7ed991f9a, user_id=48870723aed043be9db4f5923a05e8c2, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:43.096797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:43.116597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1342/2725] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:05:43 2022] PUT /identity/v3/projects/4d8820e6b7a04ca89202e7b7ed991f9a/users/48870723aed043be9db4f5923a05e8c2/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:05:43.118517 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331802-29e0-4078-aeaf-9d66f85b484d None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:43.118822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331802-29e0-4078-aeaf-9d66f85b484d None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:43.119106 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df331802-29e0-4078-aeaf-9d66f85b484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:43.141357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-df331802-29e0-4078-aeaf-9d66f85b484d None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:43.142678 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-df331802-29e0-4078-aeaf-9d66f85b484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:43.206018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1384/2726] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:43.216697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:43.217916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:43.294077 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe790c80-c089-473b-8df6-28d06c337488 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:43.298940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:43.300156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:43.300595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:43.301088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:43.312153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:43.313632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:43.323290 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1343/2727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:05:48.868444 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:48.868999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:48.868999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:48.899066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] MFA Rules not processed for user `48870723aed043be9db4f5923a05e8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:48.900549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:48.970225 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1385/2728] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:48.975440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:48.985407 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47a2ca-c2a8-4a71-a9ae-9275c94a5e11 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:48.990580 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:48.991323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:48.991678 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:48.992027 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:48.992807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:48.994839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.025349 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1344/2729] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:05:48 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:05:49.026710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:49.041834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ab10-05f6-448d-80d0-93fddbe6b258 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:49.104863 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:49.105529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:49.105812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:49.106115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:49.106992 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:49.108947 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.130390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1386/2730] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:05:49 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:05:49.134703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:49.146636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e8e-053b-4463-b945-7910e1b143af admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:49.151496 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:49.152939 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:49.153329 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:49.153660 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:49.154491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:49.156162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.170852 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1345/2731] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:05:49.175575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:49.187337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f32181-fd2d-40f0-b4b7-2b5a9155ffc8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:49.192155 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:49.193067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:49.193350 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:49.193625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] PATH_INFO: `/v3/projects/858f05d0f69741758c4c12930cc26a28/users/9daff00a2a854950b31875f6b8d9c529/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:49.210873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=858f05d0f69741758c4c12930cc26a28, user_id=9daff00a2a854950b31875f6b8d9c529, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:49.213608 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.228332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1387/2732] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:05:49 2022] PUT /identity/v3/projects/858f05d0f69741758c4c12930cc26a28/users/9daff00a2a854950b31875f6b8d9c529/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:05:49.233596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:49.244475 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35783f-3ea2-42a0-bf39-fed33f663a97 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:49.317561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:49.318231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:49.318539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:49.318814 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:49.319571 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:49.322448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5be60e-f7c3-435b-bf0c-e6462d4bc153 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.336166 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1346/2733] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:05:49.340907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:49.358775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a4a7-b0c5-4fa7-bbaf-620855baecad admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:49.364195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:49.365112 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:49.365391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:49.365665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] PATH_INFO: `/v3/projects/858f05d0f69741758c4c12930cc26a28/users/9daff00a2a854950b31875f6b8d9c529/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:49.367739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858f05d0f69741758c4c12930cc26a28, user_id=9daff00a2a854950b31875f6b8d9c529, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:49.370623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:49.383567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1388/2734] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:05:49 2022] PUT /identity/v3/projects/858f05d0f69741758c4c12930cc26a28/users/9daff00a2a854950b31875f6b8d9c529/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:05:54.661404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ac29-3245-4567-b07b-8793ba205bc3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:54.662291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ac29-3245-4567-b07b-8793ba205bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:54.662617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ac29-3245-4567-b07b-8793ba205bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:54.694325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-67f9ac29-3245-4567-b07b-8793ba205bc3 None None] MFA Rules not processed for user `9daff00a2a854950b31875f6b8d9c529`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:54.695740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-67f9ac29-3245-4567-b07b-8793ba205bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:54.766264 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1347/2735] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:54.779856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:54.781654 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:54.857823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb8eb5-690b-486f-98a1-2465a7800a05 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:54.863747 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:54.864367 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:54.864656 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:54.864936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:54.920126 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:54.921753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fb35c-7a83-41ef-8f14-111251ce54a7 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:54.931282 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1389/2736] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:05:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:05:55.935551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:55.936143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:55.936143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:55.954412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] MFA Rules not processed for user `48870723aed043be9db4f5923a05e8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:55.955658 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:55.962798 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1348/2737] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:05:56.122212 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:56.122872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:56.122872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:56.143271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:05:56.144568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:56.202854 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1390/2738] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:05:56.218740 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:05:56.220169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:05:56.301743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3d58-a8d7-4c0f-a08d-99fcf92b6492 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:05:56.310140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:05:56.310881 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:05:56.311205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:05:56.311582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:05:56.320299 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:05:56.321909 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:05:56.332703 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1349/2739] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:06:12.195931 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:12.197417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:12.260902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dec10-6384-40bd-a168-357c104474dd None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:12.265770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:12.266474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:12.266924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:12.267748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:12.269952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:12.285333 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:12.286892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:12.302694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1391/2740] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:13.297890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:13.309283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31b001-1407-4183-9a44-71383b568f6e service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:13.314589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:13.315240 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:13.315525 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:13.315802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:13.318887 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:13.335971 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:13.337510 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:13.350381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1350/2741] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:16.768714 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:16.778299 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524f84-bdd6-4ace-bef2-6514e1c35c7c service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:16.782565 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:16.783202 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:16.783491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:16.783768 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:16.785575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:16.848358 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:16.849813 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:16.859513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1392/2742] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:23.415050 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:23.418839 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:23.432539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b7a52-7848-42f1-9009-b5a7f7cbcf42 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:23.437033 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:23.437891 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:23.438177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:23.438477 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] PATH_INFO: `/v3/users/be0ebfb74d254359b4dfa36d9aff4ac6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:23.439916 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0ebfb74d254359b4dfa36d9aff4ac6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:23.441847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:23.487959 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0ebfb74d254359b4dfa36d9aff4ac6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.494801 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0ebfb74d254359b4dfa36d9aff4ac6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.495460 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0ebfb74d254359b4dfa36d9aff4ac6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.507099 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0ebfb74d254359b4dfa36d9aff4ac6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.507725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0ebfb74d254359b4dfa36d9aff4ac6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.521957 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1351/2743] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:23 2022] DELETE /identity/v3/users/be0ebfb74d254359b4dfa36d9aff4ac6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:23.698018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:23.708380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f4e6-7461-4089-b9a7-40c4a27367ac service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:23.763836 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:23.764685 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:23.764998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:23.765276 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] PATH_INFO: `/v3/projects/493768250fbb449a8b5430992e76b60f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:23.767029 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493768250fbb449a8b5430992e76b60f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:23.768935 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:23.812592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493768250fbb449a8b5430992e76b60f', 'request_id': 'req-f2941fb1-83ab-4075-9e35-aa46688fc144'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.819078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493768250fbb449a8b5430992e76b60f', 'request_id': 'req-f2941fb1-83ab-4075-9e35-aa46688fc144'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.824576 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493768250fbb449a8b5430992e76b60f', 'request_id': 'req-f2941fb1-83ab-4075-9e35-aa46688fc144'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.836983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] The token cache is being invalidate because project 493768250fbb449a8b5430992e76b60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:23.837273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.837888 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.839449 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1393/2744] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:23 2022] DELETE /identity/v3/projects/493768250fbb449a8b5430992e76b60f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:23.843693 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:23.845210 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:23.858875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22391e-39dd-4acc-8f9c-0f6031e05128 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:23.916196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:23.917067 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:23.917351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:23.917624 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] PATH_INFO: `/v3/users/13b28ec4aa4542e2831ad79eae765d2d` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:23.918861 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b28ec4aa4542e2831ad79eae765d2d)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:23.920788 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:23.966509 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b28ec4aa4542e2831ad79eae765d2d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.973518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b28ec4aa4542e2831ad79eae765d2d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.974188 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b28ec4aa4542e2831ad79eae765d2d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.985750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b28ec4aa4542e2831ad79eae765d2d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.986411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b28ec4aa4542e2831ad79eae765d2d'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:23.999506 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1352/2745] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:23 2022] DELETE /identity/v3/users/13b28ec4aa4542e2831ad79eae765d2d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:24.173302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:24.174814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:24.191739 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941fb1-83ab-4075-9e35-aa46688fc144 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:24.252146 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:24.252940 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:24.253250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:24.253530 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] PATH_INFO: `/v3/projects/5520708b8da040dab5b2b76a4dd222a1` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:24.254775 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5520708b8da040dab5b2b76a4dd222a1)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:24.256699 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:24.303332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5520708b8da040dab5b2b76a4dd222a1', 'request_id': 'req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:24.309353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5520708b8da040dab5b2b76a4dd222a1', 'request_id': 'req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:24.315193 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5520708b8da040dab5b2b76a4dd222a1', 'request_id': 'req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:24.328843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] The token cache is being invalidate because project 5520708b8da040dab5b2b76a4dd222a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:24.329138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:24.329770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:24.331377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1394/2746] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:24 2022] DELETE /identity/v3/projects/5520708b8da040dab5b2b76a4dd222a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:27.006751 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:27.008169 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:27.063212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d13d-abcb-4026-b0b5-30061db4decb admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:27.109517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:27.110090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:27.110372 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:27.110682 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:27.112435 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:27.172595 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:27.174039 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:27.183381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1353/2747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:28.811285 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:28.812881 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:28.825217 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6c0c-c008-4074-bc8b-aeea72a3b12b admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:28.829513 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:28.830162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:28.830447 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:28.830754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:28.832557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:28.848849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:28.850546 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:28.859181 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1395/2748] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:35.948178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:35.949565 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:36.005047 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883fb9a-5007-4214-b8aa-f49f8d73bc0c service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:36.008641 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:36.009274 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:36.009551 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:36.009822 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:36.011648 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:36.067519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:36.069232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:36.078005 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1354/2749] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:44.269099 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:44.277759 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c463-4513-45a3-8b53-b7f5db1f556d service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:44.281306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:44.281926 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:44.282206 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:44.282500 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:44.284273 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:44.343408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:44.344823 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:44.354280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1396/2750] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:47.479850 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:47.481083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:47.495232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7d6-e76a-4cdd-9a96-b6c817e98675 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:47.499662 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:47.500514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:47.500796 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:47.501071 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] PATH_INFO: `/v3/users/56653f5922984dde83b35ba154e97bd0` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:47.502868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56653f5922984dde83b35ba154e97bd0)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:47.504781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:47.549223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56653f5922984dde83b35ba154e97bd0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.555873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56653f5922984dde83b35ba154e97bd0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.556539 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56653f5922984dde83b35ba154e97bd0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.568866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56653f5922984dde83b35ba154e97bd0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.569768 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e7849c95-b997-455e-b1da-c3c42926b551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56653f5922984dde83b35ba154e97bd0'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.582674 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1355/2751] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:47 2022] DELETE /identity/v3/users/56653f5922984dde83b35ba154e97bd0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:47.745902 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:47.756006 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4e133-280b-4dc0-a232-81e51f48ad12 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:47.812509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:47.813380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:47.813648 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:47.813948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] PATH_INFO: `/v3/projects/3f7d501f555c4a0ba2419f68ba756db7` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:47.815128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7d501f555c4a0ba2419f68ba756db7)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:47.817046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:47.861713 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7d501f555c4a0ba2419f68ba756db7', 'request_id': 'req-02a4795b-8d03-41e6-854d-e355b58c88db'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.868250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7d501f555c4a0ba2419f68ba756db7', 'request_id': 'req-02a4795b-8d03-41e6-854d-e355b58c88db'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.873474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7d501f555c4a0ba2419f68ba756db7', 'request_id': 'req-02a4795b-8d03-41e6-854d-e355b58c88db'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.885013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] The token cache is being invalidate because project 3f7d501f555c4a0ba2419f68ba756db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:47.885302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.885917 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-02a4795b-8d03-41e6-854d-e355b58c88db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:47.887464 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1397/2752] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:47 2022] DELETE /identity/v3/projects/3f7d501f555c4a0ba2419f68ba756db7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:47.892441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:47.892735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:47.893021 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:47.911835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:47.913031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:47.971608 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1356/2753] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:47.979311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:47.979634 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:47.979916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:47.998692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:47.999822 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:48.007942 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1398/2754] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:06:48.011893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.021860 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36423a-f94f-4aba-94eb-b0c1f2eca8b3 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.026387 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.027063 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.027351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.027632 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.028355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:06:48.028668 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.030283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.042315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1357/2755] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:06:48.046450 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.055524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14685610-3022-47c8-8bf8-6365db58a326 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.060103 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.060745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.061033 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.061314 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.062012 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.064038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.089542 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1399/2756] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:06:48.093574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.103874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bae77-00d1-4a60-94f0-39f51d6bb00b admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.162805 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.163501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.163784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.164058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.164767 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.166857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.187977 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1358/2757] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:06:48.192073 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.202013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0a6d8-9594-430e-ab3e-7f53e3ab7431 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.207128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.207792 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.208077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.208354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.209093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.210753 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.221592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1400/2758] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:48.225294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.234890 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b413b-ec59-49ec-baa7-1a25de80a502 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.239518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.240152 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.240704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.240979 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.241692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.243311 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287cb14-35cb-482f-94d7-031fe9d95b57 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.254974 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1359/2759] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:06:48.258806 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.269304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ff35-872e-464e-b31b-27dc196f2040 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.273870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.275063 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.275357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.275632 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] PATH_INFO: `/v3/projects/943eba43cddb45b7a659b3040eaf45aa/users/beb0ad19197a4047adaaaa0d29bd27e6/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.290550 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943eba43cddb45b7a659b3040eaf45aa, user_id=beb0ad19197a4047adaaaa0d29bd27e6, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.293200 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.306211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1401/2760] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:48 2022] PUT /identity/v3/projects/943eba43cddb45b7a659b3040eaf45aa/users/beb0ad19197a4047adaaaa0d29bd27e6/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:48.317083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.317445 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.317727 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.343457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] MFA Rules not processed for user `beb0ad19197a4047adaaaa0d29bd27e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:48.344655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:48.406076 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1360/2761] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:48.410573 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.469022 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717108-193d-42e8-a3f3-1c850c9d8539 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.473666 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.474309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.474623 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.474901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.475592 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.477485 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.502175 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1402/2762] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:06:48.506069 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.520153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ee88c-4d04-42a3-976a-d20e8b8761b0 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.576295 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.576962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.577246 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.577522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.578218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.580836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.599606 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1361/2763] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:06:48.603567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.613720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398a2c-0935-43ea-9bb2-3be8023d6d54 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.618671 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.619321 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.619604 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.619882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.620600 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.622198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.632949 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1403/2764] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:06:48.636855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.648154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8d8-ba83-4b5e-8dfe-4e4aac4b0eae admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.652873 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.653748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.654045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.654316 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] PATH_INFO: `/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0/users/fc985d9ba33646f7aa0054f9a72e074e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.668598 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5b6e26a78f4111a0d711a5a99dbaa0, user_id=fc985d9ba33646f7aa0054f9a72e074e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.671282 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.683154 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1362/2765] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:48 2022] PUT /identity/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0/users/fc985d9ba33646f7aa0054f9a72e074e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:06:48.687098 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.697435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96161d-44e8-4360-af69-f5d4ca9cbb54 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.751020 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.752150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.752445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.752723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.753440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.755082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07750e-c068-49c0-a9fa-40a2659b19bb admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.764625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1404/2766] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:48.769218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.779255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645878-f2ef-4cc5-848b-1795f26a7435 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.783792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.784656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.784945 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.785217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] PATH_INFO: `/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0/users/fc985d9ba33646f7aa0054f9a72e074e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.787187 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5b6e26a78f4111a0d711a5a99dbaa0, user_id=fc985d9ba33646f7aa0054f9a72e074e, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.789802 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.800515 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1363/2767] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:48 2022] PUT /identity/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0/users/fc985d9ba33646f7aa0054f9a72e074e/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:06:48.810810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.811111 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.811394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.838196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] MFA Rules not processed for user `fc985d9ba33646f7aa0054f9a72e074e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:48.839446 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:48.905720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1405/2768] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:48.916162 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:48.917855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:48.972714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcef24f-2d55-4020-8917-e3ea7fcb31bc admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:48.976315 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:48.976955 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:48.977238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:48.977514 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:48.986685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:48.988111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:48.997451 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1364/2769] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:49.071144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:49.080538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb7302-517f-405d-a270-c66c8f2e673c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:49.084138 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:49.084764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:49.085046 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:49.085319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:49.139548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:49.141026 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13349c1-3176-4fc5-9dec-d337cb7c25a7 service cinder] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:49.150129 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1406/2770] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:53.155575 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:53.216989 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c46-90e1-4231-9499-0ae7ab814f01 service cinder] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:53.221423 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:53.222267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:53.222574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:53.222849 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] PATH_INFO: `/v3/users/beb0ad19197a4047adaaaa0d29bd27e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:53.224008 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb0ad19197a4047adaaaa0d29bd27e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:53.225892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:53.270136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb0ad19197a4047adaaaa0d29bd27e6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.276729 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb0ad19197a4047adaaaa0d29bd27e6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.277385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb0ad19197a4047adaaaa0d29bd27e6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.288905 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb0ad19197a4047adaaaa0d29bd27e6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.289534 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb0ad19197a4047adaaaa0d29bd27e6'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.302656 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1365/2771] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:53 2022] DELETE /identity/v3/users/beb0ad19197a4047adaaaa0d29bd27e6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:53.307159 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:53.307628 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:53.307751 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:53.324721 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:53.325916 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:53.382843 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1407/2772] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:06:53.392418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:53.393815 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:53.449522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eebd0e-9e78-4000-ad9b-5414c14720b5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:53.453055 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:53.453680 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:53.453958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:53.454233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:53.463034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:53.464448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:53.473644 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1366/2773] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:53.729077 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:53.730719 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:53.745810 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa5f5-5d87-4ee8-a51a-3854af2361e9 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:53.751296 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:53.752522 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:53.752923 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:53.753082 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] PATH_INFO: `/v3/projects/943eba43cddb45b7a659b3040eaf45aa` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:53.754428 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943eba43cddb45b7a659b3040eaf45aa)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:53.756347 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:53.802186 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943eba43cddb45b7a659b3040eaf45aa', 'request_id': 'req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.808125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943eba43cddb45b7a659b3040eaf45aa', 'request_id': 'req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.813359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943eba43cddb45b7a659b3040eaf45aa', 'request_id': 'req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.824883 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] The token cache is being invalidate because project 943eba43cddb45b7a659b3040eaf45aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:53.825169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.825788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.827357 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1408/2774] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:53 2022] DELETE /identity/v3/projects/943eba43cddb45b7a659b3040eaf45aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:53.831374 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:53.840617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093674d7-db36-4bfb-9094-80be0dd529d8 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:53.894702 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:53.895549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:53.895830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:53.896102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] PATH_INFO: `/v3/users/fc985d9ba33646f7aa0054f9a72e074e` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:53.897278 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc985d9ba33646f7aa0054f9a72e074e)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:53.899217 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:53.943065 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc985d9ba33646f7aa0054f9a72e074e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.949635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc985d9ba33646f7aa0054f9a72e074e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.950287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc985d9ba33646f7aa0054f9a72e074e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.961666 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc985d9ba33646f7aa0054f9a72e074e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.962294 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-f7e76f7b-1912-4ed0-afc9-3149ff56ae77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc985d9ba33646f7aa0054f9a72e074e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:53.975058 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1367/2775] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:53 2022] DELETE /identity/v3/users/fc985d9ba33646f7aa0054f9a72e074e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:54.235113 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.236575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:54.249805 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2d69-05e7-4831-bb1b-7708e4b0f453 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.304639 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.305497 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.305781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.306055 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] PATH_INFO: `/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.307268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5b6e26a78f4111a0d711a5a99dbaa0)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.309172 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.352637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5b6e26a78f4111a0d711a5a99dbaa0', 'request_id': 'req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:54.358541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5b6e26a78f4111a0d711a5a99dbaa0', 'request_id': 'req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:54.363856 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5b6e26a78f4111a0d711a5a99dbaa0', 'request_id': 'req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:54.375645 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] The token cache is being invalidate because project 5e5b6e26a78f4111a0d711a5a99dbaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:54.375932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:54.377064 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc04d65-f4bc-47af-ac6e-f6bbb1a04a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:54.378625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1409/2776] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:54 2022] DELETE /identity/v3/projects/5e5b6e26a78f4111a0d711a5a99dbaa0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:54.384464 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.384958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.385157 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.403176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:54.404395 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:54.467140 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1368/2777] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:06:54.475169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.475463 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.475745 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.493665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:54.494905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:54.503266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1410/2778] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:54.507342 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.516730 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80585-4e6a-408d-90a4-a1b91cb30756 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.522168 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.522866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.523150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.523425 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] PATH_INFO: `/v3/domains` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.524283 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79896) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:06:54.524731 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.526320 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.538177 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1369/2779] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:06:54.542403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.551590 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeafd9d-866d-424e-9b89-cc4af6d4d10c None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.556250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.556892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.557178 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.557455 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.558157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.560135 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.586069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1411/2780] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:06:54.590034 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.599908 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbcca0-dbf6-4c47-bcbb-4beba0bc853f admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.655991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.656581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.656866 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.657146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.657824 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.659886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.680239 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1370/2781] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:06:54.684269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.694800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e4cc-2d47-4c6e-90dd-9383058d274c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.699327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.700093 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.700373 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.700643 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.701354 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.702999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.713523 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1412/2782] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:54.717304 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.726942 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a508e-e1ac-4e15-a651-26b36dd4783d admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.731585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.732232 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.732519 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.732797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.736697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.738487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd7669-962e-4dd9-af33-7b135b85e31b admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.748735 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1371/2783] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:06:54.753458 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.763247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d61dd-b2b9-48c1-88a8-4d4b8badfb47 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.768480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.769359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.769641 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.769919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] PATH_INFO: `/v3/projects/99b0da77502a44bb85ef84c1d79ce398/users/3e8e3e69b78f48d0ae8a177392917e4a/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.783999 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b0da77502a44bb85ef84c1d79ce398, user_id=3e8e3e69b78f48d0ae8a177392917e4a, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.786688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.800673 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1413/2784] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:54 2022] PUT /identity/v3/projects/99b0da77502a44bb85ef84c1d79ce398/users/3e8e3e69b78f48d0ae8a177392917e4a/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:54.812108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.812400 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.812706 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.838778 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] MFA Rules not processed for user `3e8e3e69b78f48d0ae8a177392917e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:54.839973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:54.900607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1372/2785] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:06:54.905150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:54.963875 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c11e-ab8a-4ae3-981a-f97834fa6060 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:54.968518 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:54.969165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:54.969453 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:54.969734 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:54.970417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:54.972359 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:54.996870 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1414/2786] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:06:55.000879 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.011882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12eaa-157f-432c-b185-bc7b8acac2bb None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.066379 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.067079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.067358 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.067630 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.068307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.070207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.088868 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1373/2787] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:06:54 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:06:55.092890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.103071 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc349-b288-4637-87ab-8084ff80fea9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.107692 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.108426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.108710 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.108995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.109720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.111869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.122424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1415/2788] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:06:55.126388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.136932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9ccc0-58ce-46dc-b747-136ab624c1d9 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.141531 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.142386 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.142692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.142963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] PATH_INFO: `/v3/projects/beedbd2d9e9a4a079087e1975a82f098/users/e56caed64d4240dbba6e7df607a53c8d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.157143 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beedbd2d9e9a4a079087e1975a82f098, user_id=e56caed64d4240dbba6e7df607a53c8d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.160317 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.172963 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1374/2789] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:55 2022] PUT /identity/v3/projects/beedbd2d9e9a4a079087e1975a82f098/users/e56caed64d4240dbba6e7df607a53c8d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:55.177391 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.187366 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bbb6-a90f-41b9-986c-c19556f0ddd8 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.242707 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.243291 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.243575 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.243849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.244564 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.246157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7588f-d95e-479a-9c0c-49105be7bbfe admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.255689 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1416/2790] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:55.259739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.269675 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd8b-d704-4006-9fae-f223ad4fa4b7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.274230 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.275122 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.275397 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.275697 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] PATH_INFO: `/v3/projects/beedbd2d9e9a4a079087e1975a82f098/users/e56caed64d4240dbba6e7df607a53c8d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.277629 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=beedbd2d9e9a4a079087e1975a82f098, user_id=e56caed64d4240dbba6e7df607a53c8d, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.280943 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.291590 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1375/2791] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:55 2022] PUT /identity/v3/projects/beedbd2d9e9a4a079087e1975a82f098/users/e56caed64d4240dbba6e7df607a53c8d/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:55.301969 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.302262 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.302568 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.327627 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] MFA Rules not processed for user `e56caed64d4240dbba6e7df607a53c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:55.328849 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:55.392725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1417/2792] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:55.403401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:55.405150 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:55.462540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96536f-539c-4931-92bc-cf20877990eb admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:55.466211 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:55.466878 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:55.467199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:55.467478 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:55.522045 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:55.523441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830286-c9de-44b4-82b8-1d915acbe9fc service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:55.532627 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1376/2793] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:58.030825 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:58.101959 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e7d1-148f-4616-a77b-5eaee52760f2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:58.106511 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:58.107374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:58.107661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:58.107938 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] PATH_INFO: `/v3/users/3e8e3e69b78f48d0ae8a177392917e4a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:58.109160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8e3e69b78f48d0ae8a177392917e4a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:58.111136 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:58.156948 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8e3e69b78f48d0ae8a177392917e4a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.164544 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8e3e69b78f48d0ae8a177392917e4a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.172150 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8e3e69b78f48d0ae8a177392917e4a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.172818 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8e3e69b78f48d0ae8a177392917e4a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.173484 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8e3e69b78f48d0ae8a177392917e4a'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.192783 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1418/2794] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:58 2022] DELETE /identity/v3/users/3e8e3e69b78f48d0ae8a177392917e4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:58.197726 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:58.198529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:58.198529 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:58.215672 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:58.216870 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:58.282098 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1377/2795] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:06:58.292425 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:58.293880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:58.351577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5cd7d-fdda-43f9-b192-8394b0129d6c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:58.355231 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:58.355871 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:58.356152 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:58.356426 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:58.366504 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:58.367954 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:58.377733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1419/2796] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:06:58.660847 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:58.662736 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:58.679151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418967f-ecc9-475e-b46b-5a0bc8c0c8b1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:58.684546 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:58.685467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:58.685748 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:58.686028 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] PATH_INFO: `/v3/projects/99b0da77502a44bb85ef84c1d79ce398` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:58.687279 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b0da77502a44bb85ef84c1d79ce398)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:58.689284 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:58.737980 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b0da77502a44bb85ef84c1d79ce398', 'request_id': 'req-5423b045-2fd4-4499-a9c3-f4ebab94fa36'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.744864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b0da77502a44bb85ef84c1d79ce398', 'request_id': 'req-5423b045-2fd4-4499-a9c3-f4ebab94fa36'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.752312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b0da77502a44bb85ef84c1d79ce398', 'request_id': 'req-5423b045-2fd4-4499-a9c3-f4ebab94fa36'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.762612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] The token cache is being invalidate because project 99b0da77502a44bb85ef84c1d79ce398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:58.763001 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.763770 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.765688 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1378/2797] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:58 2022] DELETE /identity/v3/projects/99b0da77502a44bb85ef84c1d79ce398 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:58.770789 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:58.780548 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95d84d-9c4a-4de7-8d61-102698694878 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:58.845733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:58.847101 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:58.847386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:58.847670 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] PATH_INFO: `/v3/users/e56caed64d4240dbba6e7df607a53c8d` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:58.848872 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56caed64d4240dbba6e7df607a53c8d)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:58.850845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:58.897579 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56caed64d4240dbba6e7df607a53c8d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.904319 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56caed64d4240dbba6e7df607a53c8d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.911659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56caed64d4240dbba6e7df607a53c8d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.912353 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56caed64d4240dbba6e7df607a53c8d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.912988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-1f2858a3-1528-4751-b79a-f809f7fee600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56caed64d4240dbba6e7df607a53c8d'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:58.932180 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1420/2798] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:06:58 2022] DELETE /identity/v3/users/e56caed64d4240dbba6e7df607a53c8d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:59.202165 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.203714 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:59.217962 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b045-2fd4-4499-a9c3-f4ebab94fa36 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.275472 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.276337 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.276659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.276892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] PATH_INFO: `/v3/projects/beedbd2d9e9a4a079087e1975a82f098` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.278088 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beedbd2d9e9a4a079087e1975a82f098)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.280100 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.326792 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beedbd2d9e9a4a079087e1975a82f098', 'request_id': 'req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:59.332893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beedbd2d9e9a4a079087e1975a82f098', 'request_id': 'req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:59.340093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beedbd2d9e9a4a079087e1975a82f098', 'request_id': 'req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:59.350655 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] The token cache is being invalidate because project beedbd2d9e9a4a079087e1975a82f098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:06:59.350935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:59.351559 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c9a394b5-9ce3-47b8-84eb-7e94a67ce191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:06:59.353107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1379/2799] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:06:59 2022] DELETE /identity/v3/projects/beedbd2d9e9a4a079087e1975a82f098 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:59.358160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.358659 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.358786 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.376996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:59.378866 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:59.437032 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1421/2800] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:59.445474 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.445764 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.446048 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.464413 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:59.465617 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:59.473790 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1380/2801] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:59.478211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.488195 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b203648-6d7e-4716-a806-cb41e978ded2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.493115 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.493757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.494038 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.494309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.495067 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:06:59.495369 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.496987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.509108 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1422/2802] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:06:59.513432 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.522883 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0c37e-ed80-478a-a58f-b051180ba8c7 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.528004 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.528336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.528620 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.528897 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.529588 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.531581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.559517 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1381/2803] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:06:59 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:06:59.564374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.575016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2adc-e8d4-40e9-b934-77200f21e61d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.629017 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.629586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.629869 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.630144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.630850 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.632754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.651951 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1423/2804] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:06:59 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:06:59.656146 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.666836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324c2c1-2625-4232-83c7-a8d90e45bae7 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.671473 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.672124 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.672411 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.672692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.673422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.675734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.687144 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1382/2805] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:59.691040 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.700712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87a953-34a9-424d-803a-ee53ad39ccc0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.705250 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.705907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.706190 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.706480 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.707284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.708882 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945d532-7980-4a41-bab2-2ab5f00fdd76 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.719189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1424/2806] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:06:59.724874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.735330 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d14ebf-e6ee-4a2b-a939-61d7cb827040 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.740694 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.741837 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.742120 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.742392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] PATH_INFO: `/v3/projects/ec9446bbea1043e78b4f0d1831ea53ff/users/4b3a2dcac60b45dcaa2b258a7ac52ddb/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.757031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9446bbea1043e78b4f0d1831ea53ff, user_id=4b3a2dcac60b45dcaa2b258a7ac52ddb, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.759723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.774196 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1383/2807] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:06:59 2022] PUT /identity/v3/projects/ec9446bbea1043e78b4f0d1831ea53ff/users/4b3a2dcac60b45dcaa2b258a7ac52ddb/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:06:59.786386 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.786723 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.787008 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.813051 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] MFA Rules not processed for user `4b3a2dcac60b45dcaa2b258a7ac52ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:06:59.814261 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:59.876857 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1425/2808] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:06:59.888254 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:06:59.889968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:06:59.955593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b4de-8ecb-4fd3-b21c-49c8b743085c admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:06:59.959258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:06:59.959900 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:06:59.960180 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:06:59.960457 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:06:59.968811 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:06:59.970233 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8164-f3b0-4766-bc5a-b7cc83c077d7 service glance] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:06:59.979518 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1384/2809] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:07:32.105279 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.164746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449fc0b-53bc-4134-ba5a-f977efd744e3 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:32.169433 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:32.170323 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.170637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.170914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] PATH_INFO: `/v3/users/4b3a2dcac60b45dcaa2b258a7ac52ddb` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.172336 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3a2dcac60b45dcaa2b258a7ac52ddb)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:32.174676 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:32.220809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3a2dcac60b45dcaa2b258a7ac52ddb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.228176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3a2dcac60b45dcaa2b258a7ac52ddb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.236958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3a2dcac60b45dcaa2b258a7ac52ddb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.237620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3a2dcac60b45dcaa2b258a7ac52ddb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.238243 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3a2dcac60b45dcaa2b258a7ac52ddb'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.255987 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1426/2810] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:07:32 2022] DELETE /identity/v3/users/4b3a2dcac60b45dcaa2b258a7ac52ddb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:32.260504 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.261593 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.261725 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.278029 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:32.279242 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:32.336059 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1385/2811] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:32.345515 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.346936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:32.402016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266ff14-ea30-403c-96de-d92c2237c71d admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:32.405665 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:32.406302 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.406622 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.406901 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.415640 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:32.417569 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f090f2-16a7-4fc6-9cf8-b1d994f5f105 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:32.426765 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1427/2812] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:32.684131 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.685552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:32.699083 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95af283-ae7b-4dde-89fb-51d74d91a595 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:32.703932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:32.704797 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.705082 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.705362 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] PATH_INFO: `/v3/projects/ec9446bbea1043e78b4f0d1831ea53ff` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.706686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9446bbea1043e78b4f0d1831ea53ff)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:32.708573 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:32.754704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9446bbea1043e78b4f0d1831ea53ff', 'request_id': 'req-26e15876-c0a0-46fb-acd0-b47d646119d1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.760647 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9446bbea1043e78b4f0d1831ea53ff', 'request_id': 'req-26e15876-c0a0-46fb-acd0-b47d646119d1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.767940 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9446bbea1043e78b4f0d1831ea53ff', 'request_id': 'req-26e15876-c0a0-46fb-acd0-b47d646119d1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.777896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] The token cache is being invalidate because project ec9446bbea1043e78b4f0d1831ea53ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:07:32.778178 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.778821 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-26e15876-c0a0-46fb-acd0-b47d646119d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:32.780336 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1386/2813] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:07:32 2022] DELETE /identity/v3/projects/ec9446bbea1043e78b4f0d1831ea53ff => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:07:32.785057 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.785348 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.785620 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.803197 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:32.804384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:32.861958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1428/2814] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:32.870019 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.870307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.870621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.889089 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:32.890293 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:32.898044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1387/2815] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:07:32.902662 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.912406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0cd96-c144-46fa-8acc-27c8f8ef5a35 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:32.917607 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:32.918257 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.918580 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.918862 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.919613 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:07:32.919927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:32.921557 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:32.932839 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1429/2816] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:07:32.936654 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.945540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64172-67cc-43bb-97de-4ec0e68f16e5 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:32.950359 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:32.951031 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:32.951312 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:32.951585 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:32.952268 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:32.954153 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:32.978804 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1388/2817] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:07:32 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:32.983424 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:32.993469 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364d37-c4db-428a-93fa-bf9afb0b6d53 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:33.047255 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:33.047905 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.048189 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.048465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.049157 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:33.051105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:33.070161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1430/2818] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:07:32 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:33.074203 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:33.084199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8b5c8-17d2-4527-96b6-edbd45144945 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:33.089286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:33.089933 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.090212 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.090505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.091223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:33.092810 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:33.103415 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1389/2819] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:07:33.107973 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:33.118016 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e041cc-e8ef-4d79-9cc7-014e2a9834f2 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:33.122581 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:33.123229 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.123516 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.123799 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.124519 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:33.126116 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e27cc3-ee46-427b-9dcd-717f470aa215 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:33.135746 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1431/2820] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:33.139621 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:33.149236 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b6d0a-5f48-4fee-ae9e-3395c2129721 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:33.154207 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:33.155097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.155385 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.155659 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] PATH_INFO: `/v3/projects/10d019d291d249039be77f2da5f723ea/users/9ea78b6584bf480f88bb60224735889f/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.170108 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d019d291d249039be77f2da5f723ea, user_id=9ea78b6584bf480f88bb60224735889f, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:33.173172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:33.185267 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1390/2821] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:07:33 2022] PUT /identity/v3/projects/10d019d291d249039be77f2da5f723ea/users/9ea78b6584bf480f88bb60224735889f/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:33.196127 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.196417 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.196696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.224845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] MFA Rules not processed for user `9ea78b6584bf480f88bb60224735889f`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:33.226050 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:33.288042 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1432/2822] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:07:33.299226 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:33.300925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:33.356846 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7166e17-4288-4b9c-8bc3-af34e9a1df07 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:33.360484 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:33.361126 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:33.361422 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:33.361929 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:33.370347 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:33.371753 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077937f-54e1-4317-900c-8a09abdf1d77 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:33.380298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1391/2823] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:35.890145 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:35.949268 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a16a-813d-4169-b38f-619f58e17fed None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:35.953726 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:35.954606 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:35.954893 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:35.955169 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] PATH_INFO: `/v3/users/9ea78b6584bf480f88bb60224735889f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:35.956342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea78b6584bf480f88bb60224735889f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:35.958259 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.002510 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea78b6584bf480f88bb60224735889f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.009001 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea78b6584bf480f88bb60224735889f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.016532 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea78b6584bf480f88bb60224735889f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.017242 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea78b6584bf480f88bb60224735889f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.017900 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea78b6584bf480f88bb60224735889f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.035105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1433/2824] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:07:35 2022] DELETE /identity/v3/users/9ea78b6584bf480f88bb60224735889f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:36.039636 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.040129 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.040241 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.056783 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:36.058010 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:36.114105 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1392/2825] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:07:36.124625 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.126125 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:36.181892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7509b30-d5b7-4e46-ac93-3c252c3d3ba0 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.186174 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.186845 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.187128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.187403 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.196271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.197701 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336957d-846b-4091-af99-ad0512cf8f66 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.206965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1434/2826] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:36.467533 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.469000 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:36.481137 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df8bfd-145d-4609-9293-ea487fa24504 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.485771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.486657 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.486941 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.487218 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] PATH_INFO: `/v3/projects/10d019d291d249039be77f2da5f723ea` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.488392 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d019d291d249039be77f2da5f723ea)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.490399 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.539607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d019d291d249039be77f2da5f723ea', 'request_id': 'req-a8821c6a-de81-4ac4-b299-264daf4ae23e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.545935 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d019d291d249039be77f2da5f723ea', 'request_id': 'req-a8821c6a-de81-4ac4-b299-264daf4ae23e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.553540 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d019d291d249039be77f2da5f723ea', 'request_id': 'req-a8821c6a-de81-4ac4-b299-264daf4ae23e'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.564313 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] The token cache is being invalidate because project 10d019d291d249039be77f2da5f723ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:07:36.564607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.565224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-a8821c6a-de81-4ac4-b299-264daf4ae23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:36.566818 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1393/2827] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:07:36 2022] DELETE /identity/v3/projects/10d019d291d249039be77f2da5f723ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:36.572341 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.572637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.572950 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.593119 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:36.594342 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:36.652983 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1435/2828] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:36.660404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.660692 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.660967 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.679202 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:36.680388 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:36.688214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1394/2829] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:36.692305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.701781 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5836c-65e7-43bd-af12-890c12bc96e4 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.706377 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.707090 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.707378 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.707658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.708381 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:07:36.708694 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.710306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.721988 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1436/2830] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:07:36.725830 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.735401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813064-0a40-4300-82fc-3fe90aaa6d42 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.739969 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.740597 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.740875 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.741145 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.741832 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.744002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.769002 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1395/2831] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:36.773223 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.783011 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3e8f-902c-48c5-8eed-b8e037835711 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.838589 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.839266 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.839541 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.840124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.840827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.842835 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.862265 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1437/2832] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:36.866521 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.877592 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ea0b-1754-4708-8e4d-50d0f8ecae82 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.882252 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.882936 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.883223 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.883501 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.884220 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.885817 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.897679 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1396/2833] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:36.901720 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.911696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e50-e147-4076-bc8a-7fdab16827cd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.916234 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.916909 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.917191 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.917552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.918826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.920413 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baf5aa-f9ba-4960-a127-f253078cb75c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.930092 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1438/2834] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:36.934686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:36.944416 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac599f-8ae2-40eb-978c-b9ab2f9f4142 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:36.948995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:36.949853 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.950133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.950406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] PATH_INFO: `/v3/projects/ef3417ce854b42538ca0ba9c8ff1231c/users/12a2a87aaa04414aab1d26376ed8d54f/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:36.964291 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3417ce854b42538ca0ba9c8ff1231c, user_id=12a2a87aaa04414aab1d26376ed8d54f, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:36.966968 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:36.979787 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1397/2835] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:07:36 2022] PUT /identity/v3/projects/ef3417ce854b42538ca0ba9c8ff1231c/users/12a2a87aaa04414aab1d26376ed8d54f/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:07:36.990271 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:36.990601 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:36.990880 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.017211 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] MFA Rules not processed for user `12a2a87aaa04414aab1d26376ed8d54f`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:37.018406 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.079696 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1439/2836] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:37.091701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:37.093469 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.149259 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46208ddb-0d08-434c-89ac-1e99d954d224 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:37.152921 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34dcdccc1deb40478957efe9bf78dff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:37.153561 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.153843 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.154118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.162348 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:37.163743 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d217ae-1702-4a18-86b7-8c066933ead4 service cinder] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:37.172992 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1398/2837] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:37.198788 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:37.260183 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994868b-c5eb-41a0-afc5-49ae59a8aabb None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:37.265023 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:37.265890 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.266171 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.266481 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] PATH_INFO: `/v3/users/12a2a87aaa04414aab1d26376ed8d54f` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.267680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a2a87aaa04414aab1d26376ed8d54f)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:37.269603 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:37.314907 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a2a87aaa04414aab1d26376ed8d54f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.321906 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a2a87aaa04414aab1d26376ed8d54f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.329899 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a2a87aaa04414aab1d26376ed8d54f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.330646 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a2a87aaa04414aab1d26376ed8d54f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.331269 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a2a87aaa04414aab1d26376ed8d54f'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.347529 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1440/2838] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:07:37 2022] DELETE /identity/v3/users/12a2a87aaa04414aab1d26376ed8d54f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:37.352003 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.352292 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.352572 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.369671 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:37.370917 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.428057 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1399/2839] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:37.438137 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:37.439630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.495216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a2ca-a7ec-4c55-9244-d3f9251c22bc admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:37.499509 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:37.500179 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.500465 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.500743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.509668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:37.511162 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b539285-94e3-4b05-a613-3dea38179883 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:37.521260 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1441/2840] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:37.779985 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:37.781428 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.795361 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091257f-02a8-47e5-802c-20e6d63834db None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:37.800686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:37.801898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.802200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.802591 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] PATH_INFO: `/v3/projects/ef3417ce854b42538ca0ba9c8ff1231c` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.803835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3417ce854b42538ca0ba9c8ff1231c)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:37.805825 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:37.852687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3417ce854b42538ca0ba9c8ff1231c', 'request_id': 'req-ecc2565e-b549-49c1-ac3c-0fe634d680a5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.859200 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3417ce854b42538ca0ba9c8ff1231c', 'request_id': 'req-ecc2565e-b549-49c1-ac3c-0fe634d680a5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.866449 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3417ce854b42538ca0ba9c8ff1231c', 'request_id': 'req-ecc2565e-b549-49c1-ac3c-0fe634d680a5'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.877173 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] The token cache is being invalidate because project ef3417ce854b42538ca0ba9c8ff1231c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79896) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:07:37.877454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.878060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-ecc2565e-b549-49c1-ac3c-0fe634d680a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:07:37.879607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1400/2841] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:07:37 2022] DELETE /identity/v3/projects/ef3417ce854b42538ca0ba9c8ff1231c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:37.884452 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056571-34cb-4217-85ad-20231579dc28 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:37.884743 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056571-34cb-4217-85ad-20231579dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:37.885018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056571-34cb-4217-85ad-20231579dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:37.903192 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-96056571-34cb-4217-85ad-20231579dc28 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:37.904384 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-96056571-34cb-4217-85ad-20231579dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:37.964535 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1442/2842] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:38.023594 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.023912 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.024189 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.043102 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:38.044309 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:38.052186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1401/2843] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:38.056308 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056571-34cb-4217-85ad-20231579dc28 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.066680 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056571-34cb-4217-85ad-20231579dc28 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.071549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.072203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.072492 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.072769 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.073521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:07:38.073829 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.076019 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.087526 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1443/2844] 10.222.0.57 () {58 vars in 1152 bytes} [Tue May 10 20:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:07:38.091859 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.100964 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092f0dd-36db-4686-a7b9-2f6fa3dae437 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.105563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.106231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.106536 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.106835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.107528 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.109440 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.134111 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1402/2845] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:07:38.138778 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.148508 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f7941-084b-40ac-9c74-e4950761db9c admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.205078 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.205748 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.206034 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.206332 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.207068 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.209027 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.228322 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1444/2846] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:07:38 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:38.232324 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.242634 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdbf1-8520-4033-bb83-a151deaf4228 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.249406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.250060 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.250404 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.250958 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.252355 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.254228 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.266325 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1403/2847] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:38.270388 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.280427 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb217-67ba-47ae-95ea-fb73bcd65c72 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.285196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.285846 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.286161 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.286440 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] PATH_INFO: `/v3/roles` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.287203 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.288809 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfd45c-5dc5-49f4-9286-0d363caee75c admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.298924 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1445/2848] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:38.302988 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.313366 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25738-ce63-49ad-973a-69bd89e0cf69 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.317993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.318898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] REQUEST_METHOD: `PUT` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.319191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.319454 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] PATH_INFO: `/v3/projects/b52def9bc7f1456398c9f2ad21235015/users/e239c11d804746c4a68ded15127755c1/roles/c6aede8225634ab38adb58c045afc716` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.334704 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52def9bc7f1456398c9f2ad21235015, user_id=e239c11d804746c4a68ded15127755c1, role_id=c6aede8225634ab38adb58c045afc716)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.337363 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.349907 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1404/2849] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:07:38 2022] PUT /identity/v3/projects/b52def9bc7f1456398c9f2ad21235015/users/e239c11d804746c4a68ded15127755c1/roles/c6aede8225634ab38adb58c045afc716 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:38.354757 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9d03-7f8e-4803-a5a4-0c9d7db33612 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.355053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9d03-7f8e-4803-a5a4-0c9d7db33612 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.355364 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9d03-7f8e-4803-a5a4-0c9d7db33612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.373305 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-567b9d03-7f8e-4803-a5a4-0c9d7db33612 None None] MFA Rules not processed for user `88a33ed416d14d68b26b32e116862838`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:38.374570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-567b9d03-7f8e-4803-a5a4-0c9d7db33612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:38.431013 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1446/2850] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:38.442685 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:38.444418 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:38.501296 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07ce17-3944-4bd4-ad63-6fbe808749da admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:38.504904 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:38.505552 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:38.505827 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:38.506097 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:38.516142 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:38.518115 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:38.528781 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1405/2851] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:42.755952 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:42.756421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:42.756520 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:42.788972 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] MFA Rules not processed for user `e239c11d804746c4a68ded15127755c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:42.790198 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:42.859128 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1447/2852] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:42.863738 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:42.874107 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020361b6-9b80-40b2-a4d4-6e2469544291 service neutron] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:42.878689 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:42.879344 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:42.879855 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:42.880289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:42.881186 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:42.883127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:42.913448 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1406/2853] 10.222.0.57 () {60 vars in 1152 bytes} [Tue May 10 20:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:07:42.917467 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:42.929860 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4be1b-60f7-4218-84a5-f9d6f3cce6a2 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:42.988821 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:42.989637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:42.989989 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:42.990395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] PATH_INFO: `/v3/users` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:42.991131 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:42.993362 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:43.014491 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1448/2854] 10.222.0.57 () {60 vars in 1143 bytes} [Tue May 10 20:07:42 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:07:43.018365 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:43.029265 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18992b9d-3110-419e-bc99-3fd7c1942bc6 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:43.033886 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:43.034583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:43.034894 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:43.035170 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:43.035899 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:43.037491 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:43.049176 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1407/2855] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:07:43.053637 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:43.064528 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10bf1a-4f90-43fb-a75b-66e16764648a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:43.069408 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:43.070451 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:43.070767 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:43.071049 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] PATH_INFO: `/v3/projects/986d224cf5af4de98a59602aceb837a6/users/e6dafb439ac643c1bbf690d39d0eff22/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:43.086858 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986d224cf5af4de98a59602aceb837a6, user_id=e6dafb439ac643c1bbf690d39d0eff22, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:43.089538 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:43.106574 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1449/2856] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:07:43 2022] PUT /identity/v3/projects/986d224cf5af4de98a59602aceb837a6/users/e6dafb439ac643c1bbf690d39d0eff22/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:07:43.110351 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:43.124739 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0782e-7ecd-4c83-8af4-59bbefba735e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:43.202123 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:43.202926 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:43.203214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:43.203494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:43.204227 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:43.205829 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a410ffe-d23f-4e6e-b39d-0cd236d149b7 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:43.215467 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1408/2857] 10.222.0.57 () {58 vars in 1121 bytes} [Tue May 10 20:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:07:43.219770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:43.232958 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2511-5537-454c-9cb8-465e63f186c5 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:43.237936 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:43.239060 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] REQUEST_METHOD: `PUT` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:43.239355 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:43.239638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] PATH_INFO: `/v3/projects/986d224cf5af4de98a59602aceb837a6/users/e6dafb439ac643c1bbf690d39d0eff22/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:43.241830 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=986d224cf5af4de98a59602aceb837a6, user_id=e6dafb439ac643c1bbf690d39d0eff22, role_id=cbcb58ce3a3f423c9cba7b2e321ce1e6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:43.244807 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:43.256834 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1450/2858] 10.222.0.57 () {60 vars in 1482 bytes} [Tue May 10 20:07:43 2022] PUT /identity/v3/projects/986d224cf5af4de98a59602aceb837a6/users/e6dafb439ac643c1bbf690d39d0eff22/roles/cbcb58ce3a3f423c9cba7b2e321ce1e6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:07:47.624715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071be9-74d6-413b-922b-ab00f5bc4459 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:47.625323 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071be9-74d6-413b-922b-ab00f5bc4459 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:47.625424 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071be9-74d6-413b-922b-ab00f5bc4459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:47.656199 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-02071be9-74d6-413b-922b-ab00f5bc4459 None None] MFA Rules not processed for user `e6dafb439ac643c1bbf690d39d0eff22`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:47.657433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-02071be9-74d6-413b-922b-ab00f5bc4459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:47.733160 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1409/2859] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:07:47.745176 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:47.746927 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:47.804160 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fd75-b006-48f5-b550-cb80a124f91a admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:47.808274 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '488a9120fefb464f9c9ff8faeb3f8668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:47.809165 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:47.809653 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:47.809929 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:47.865826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:47.867221 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:47.876287 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1451/2860] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:07:47.976133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07662b-da75-4f0c-8371-993e3006f5d3 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:47.976512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07662b-da75-4f0c-8371-993e3006f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:47.976864 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07662b-da75-4f0c-8371-993e3006f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:47.996766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-6c07662b-da75-4f0c-8371-993e3006f5d3 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:47.998094 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-6c07662b-da75-4f0c-8371-993e3006f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:48.055327 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1410/2861] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:07:48.106130 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:48.107577 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:48.178346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff026-2bd8-40c9-84f6-9ef2eb7153e7 service glance] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:48.183524 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:48.184718 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:48.185300 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:48.185597 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:48.202703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:48.204630 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:48.213284 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1452/2862] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:07:57.061061 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:57.061612 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:57.061920 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:57.080215 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] MFA Rules not processed for user `e239c11d804746c4a68ded15127755c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:57.081401 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:57.088258 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1411/2863] 10.222.0.57 () {58 vars in 957 bytes} [Tue May 10 20:07:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:57.336771 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:57.338264 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:57.394937 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14367ae0-7f44-4efc-bfba-2fd274b6fb68 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:57.398390 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:57.399054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:57.399337 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:57.399612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:57.401344 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:57.410612 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:57.412031 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d3456-4a69-43c0-92ee-610c5d3dd892 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:57.419827 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1453/2864] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:57.736512 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:57.737872 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:57.808925 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8aff-68bb-48bf-89a6-f6a9085a0e23 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:57.813807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:57.814443 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:57.814750 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:57.815024 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:57.816765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:57.828214 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:57.829771 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:57.839270 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1412/2865] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:07:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:07:59.073025 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:59.073521 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:59.073712 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:59.092164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:07:59.093468 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:07:59.100756 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1454/2866] 10.222.0.57 () {58 vars in 1009 bytes} [Tue May 10 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:07:59.113755 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:07:59.125582 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d5d57-101c-4da2-b961-8389342fd5dc service placement] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:07:59.130136 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:07:59.130807 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:07:59.131091 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:07:59.131364 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:07:59.140191 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:07:59.141785 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:07:59.150307 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1413/2867] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:08:12.533139 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:08:12.534725 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:08:12.611552 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e3bd-6f68-4a77-9bf9-1c9203ebc4ec None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:08:12.617035 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:08:12.617672 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:12.617953 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:12.618275 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:12.620375 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:08:12.632724 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:08:12.634292 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:08:12.645208 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1455/2868] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:08:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:08:25.660301 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:08:25.696151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e141-ed95-429d-8c6d-86d4d14c419c service swift] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:08:25.699794 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:08:25.700433 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:25.700718 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:25.700995 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:25.729733 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:08:25.731127 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add744ab-f059-45fb-8f85-8d2f251c17f3 service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:08:25.740581 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1414/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:08:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:08:28.930343 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:08:28.999124 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6cea5-b4d7-4d1b-aa9c-03634252c63f service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:08:29.005184 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:08:29.006081 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:29.006543 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:29.006995 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:29.009164 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:08:29.039877 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:08:29.041812 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b7094-be91-48b2-bd52-aabb9861c6f2 service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:08:29.057069 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1456/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:08:40.185549 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ffc9-e5b6-426a-ba15-dd8856bfffb1 None None] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.186134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ffc9-e5b6-426a-ba15-dd8856bfffb1 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.186134 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ffc9-e5b6-426a-ba15-dd8856bfffb1 None None] PATH_INFO: `/` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.187589 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1415/2871] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 20:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:08:40.194549 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335fbb-4c6c-46bf-8cee-a4077d777fac None None] REQUEST_METHOD: `POST` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.195072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335fbb-4c6c-46bf-8cee-a4077d777fac None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.195194 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92335fbb-4c6c-46bf-8cee-a4077d777fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.244570 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.auth.core [None req-92335fbb-4c6c-46bf-8cee-a4077d777fac None None] MFA Rules not processed for user `072f8b74eaa248b3be4499823156491e`. Rule list: `[]` (Enabled: `True`). {{(pid=79897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:08:40.245914 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-92335fbb-4c6c-46bf-8cee-a4077d777fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:08:40.252820 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1457/2872] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:08:40.270405 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ffc9-e5b6-426a-ba15-dd8856bfffb1 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:08:40.281151 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ffc9-e5b6-426a-ba15-dd8856bfffb1 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:08:40.284734 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:08:40.285431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.285717 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.285991 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.293286 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:08:40.294701 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8e4e5-008a-4644-932d-3cfda9c6890a service neutron] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:08:40.303238 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1416/2873] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:08:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:08:40.387018 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660d2-9578-47cb-9a57-7c8052fd3ea7 None None] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.387311 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660d2-9578-47cb-9a57-7c8052fd3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.387586 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660d2-9578-47cb-9a57-7c8052fd3ea7 None None] PATH_INFO: `/` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.388967 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1458/2874] 10.222.0.57 () {54 vars in 921 bytes} [Tue May 10 20:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:08:40.394172 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.394494 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.394836 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.412628 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] MFA Rules not processed for user `fdcb012cc78d44a2afb7762daa15517c`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:08:40.413766 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:08:40.423073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1417/2875] 10.222.0.57 () {58 vars in 1018 bytes} [Tue May 10 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:08:40.433826 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039660d2-9578-47cb-9a57-7c8052fd3ea7 None None] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:08:40.445306 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039660d2-9578-47cb-9a57-7c8052fd3ea7 None None] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:08:40.448873 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072f8b74eaa248b3be4499823156491e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:08:40.449493 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:08:40.449803 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:08:40.450079 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:08:40.459919 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:08:40.461331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:08:40.471633 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1459/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:08:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:09:24.257018 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:24.278164 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff3ec-e3aa-4897-8a7b-3195249cd694 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:24.283096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:24.283723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:24.284020 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:24.284273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:24.285993 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:09:24.309482 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:24.311079 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a31bff-8c3f-48e3-a13b-f35273ba6219 service placement] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:24.320984 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1418/2877] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:09:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:09:44.988389 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:45.017072 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc7241-7809-4725-a3e5-2c46a3e9ba67 service neutron] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:45.022668 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdcb012cc78d44a2afb7762daa15517c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:45.023309 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:45.023593 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:45.023884 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:45.025915 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:09:45.051644 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:45.053143 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:45.064703 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1460/2878] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:09:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:09:46.043044 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] REQUEST_METHOD: `POST` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:46.043495 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:46.043600 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:46.061093 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.auth.core [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] MFA Rules not processed for user `d61df7a7c5b24a3482bff127f4d63d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79896) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:09:46.062298 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:09:46.069389 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1419/2879] 10.222.0.57 () {58 vars in 967 bytes} [Tue May 10 20:09:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:09:46.108776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:46.120448 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0477a0-fbb5-4ebb-bf31-dd598f5f703a service nova] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:46.125657 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983fe7993d594683afbc43f4a95885a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:46.126290 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] REQUEST_METHOD: `GET` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:46.126715 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:46.126998 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:46.135474 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:46.137056 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:46.144965 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1461/2880] 10.222.0.57 () {60 vars in 1384 bytes} [Tue May 10 20:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:09:52.774563 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:52.854683 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4bc5-c77d-4d8d-8e59-3448e493e135 None None] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:52.860205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:52.861096 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:52.861431 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:52.861932 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] PATH_INFO: `/v3/users/e239c11d804746c4a68ded15127755c1` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:52.863893 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e239c11d804746c4a68ded15127755c1)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:52.865857 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:52.917156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e239c11d804746c4a68ded15127755c1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:52.923715 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e239c11d804746c4a68ded15127755c1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:52.924380 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e239c11d804746c4a68ded15127755c1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:52.936133 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e239c11d804746c4a68ded15127755c1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:52.936765 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e239c11d804746c4a68ded15127755c1'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:52.949665 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1420/2881] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:09:52 2022] DELETE /identity/v3/users/e239c11d804746c4a68ded15127755c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:09:53.113945 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:53.125996 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebebc-9c25-41ef-8711-d11217d76cb2 service swift] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:53.181892 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:53.182770 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:53.183054 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:53.183327 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] PATH_INFO: `/v3/projects/b52def9bc7f1456398c9f2ad21235015` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:53.184754 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52def9bc7f1456398c9f2ad21235015)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:53.187380 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:53.233975 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52def9bc7f1456398c9f2ad21235015', 'request_id': 'req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.240105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52def9bc7f1456398c9f2ad21235015', 'request_id': 'req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.246421 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52def9bc7f1456398c9f2ad21235015', 'request_id': 'req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.270247 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] The token cache is being invalidate because project b52def9bc7f1456398c9f2ad21235015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:09:53.270567 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.271196 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.272733 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1462/2882] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:09:53 2022] DELETE /identity/v3/projects/b52def9bc7f1456398c9f2ad21235015 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:09:53.276784 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:53.278181 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:09:53.291505 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bd464-83d1-44d7-beae-7d71c2b14859 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:53.346081 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:53.346973 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:53.347255 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:53.347522 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] PATH_INFO: `/v3/users/e6dafb439ac643c1bbf690d39d0eff22` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:53.348892 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dafb439ac643c1bbf690d39d0eff22)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:53.350898 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:53.397468 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dafb439ac643c1bbf690d39d0eff22'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.404762 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dafb439ac643c1bbf690d39d0eff22'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.405412 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dafb439ac643c1bbf690d39d0eff22'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.416429 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dafb439ac643c1bbf690d39d0eff22'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.417113 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dafb439ac643c1bbf690d39d0eff22'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.429554 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1421/2883] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:09:53 2022] DELETE /identity/v3/users/e6dafb439ac643c1bbf690d39d0eff22 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:09:53.610499 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:09:53.612435 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:09:53.627932 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fcfbc-c575-4f06-a0d9-e40ca188d6bd admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:09:53.690066 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:09:53.690878 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:09:53.691166 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:09:53.691443 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] PATH_INFO: `/v3/projects/986d224cf5af4de98a59602aceb837a6` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:09:53.692688 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986d224cf5af4de98a59602aceb837a6)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:09:53.694658 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:09:53.743394 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986d224cf5af4de98a59602aceb837a6', 'request_id': 'req-9252f519-2ce7-4c75-b108-0431ec197ba9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.750105 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986d224cf5af4de98a59602aceb837a6', 'request_id': 'req-9252f519-2ce7-4c75-b108-0431ec197ba9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.755697 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986d224cf5af4de98a59602aceb837a6', 'request_id': 'req-9252f519-2ce7-4c75-b108-0431ec197ba9'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.768346 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] The token cache is being invalidate because project 986d224cf5af4de98a59602aceb837a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:09:53.768638 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.769280 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:09:53.770978 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1463/2884] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:09:53 2022] DELETE /identity/v3/projects/986d224cf5af4de98a59602aceb837a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:10:16.956441 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:10:16.958487 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:10:16.971994 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1c4e-4f58-48db-ab32-b0624d48a29e admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:10:17.030224 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:10:17.031118 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:10:17.031406 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:10:17.031686 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] PATH_INFO: `/v3/users/48870723aed043be9db4f5923a05e8c2` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:10:17.032874 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48870723aed043be9db4f5923a05e8c2)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:10:17.034835 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:10:17.079231 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48870723aed043be9db4f5923a05e8c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.086037 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48870723aed043be9db4f5923a05e8c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.086723 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48870723aed043be9db4f5923a05e8c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.098371 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48870723aed043be9db4f5923a05e8c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.099080 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48870723aed043be9db4f5923a05e8c2'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.111896 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1422/2885] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:10:16 2022] DELETE /identity/v3/users/48870723aed043be9db4f5923a05e8c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:10:17.279430 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:10:17.281053 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:10:17.295304 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f519-2ce7-4c75-b108-0431ec197ba9 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:10:17.351365 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:10:17.352216 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:10:17.352495 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:10:17.352764 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] PATH_INFO: `/v3/projects/4d8820e6b7a04ca89202e7b7ed991f9a` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:10:17.354432 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8820e6b7a04ca89202e7b7ed991f9a)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:10:17.356374 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:10:17.400731 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8820e6b7a04ca89202e7b7ed991f9a', 'request_id': 'req-d4637d15-1b9d-421d-900e-805890c23362'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.406661 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8820e6b7a04ca89202e7b7ed991f9a', 'request_id': 'req-d4637d15-1b9d-421d-900e-805890c23362'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.411814 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8820e6b7a04ca89202e7b7ed991f9a', 'request_id': 'req-d4637d15-1b9d-421d-900e-805890c23362'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.424395 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] The token cache is being invalidate because project 4d8820e6b7a04ca89202e7b7ed991f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:10:17.424815 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.425459 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.427044 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1464/2886] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:10:17 2022] DELETE /identity/v3/projects/4d8820e6b7a04ca89202e7b7ed991f9a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:10:17.431687 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:10:17.433156 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:10:17.445635 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16307e4-20a0-41c8-aedf-c307ee185551 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:10:17.500745 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:10:17.501607 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:10:17.501888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:10:17.502163 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] PATH_INFO: `/v3/users/9daff00a2a854950b31875f6b8d9c529` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:10:17.503381 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daff00a2a854950b31875f6b8d9c529)` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:10:17.505289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:10:17.554073 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daff00a2a854950b31875f6b8d9c529'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.561888 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daff00a2a854950b31875f6b8d9c529'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.562618 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daff00a2a854950b31875f6b8d9c529'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.574574 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daff00a2a854950b31875f6b8d9c529'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.575273 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.notifications [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daff00a2a854950b31875f6b8d9c529'} {{(pid=79896) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.591090 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1423/2887] 10.222.0.57 () {58 vars in 1223 bytes} [Tue May 10 20:10:17 2022] DELETE /identity/v3/users/9daff00a2a854950b31875f6b8d9c529 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:10:17.765182 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Authenticating user token {{(pid=79897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:10:17.766908 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.fernet_utils [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:10:17.781400 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637d15-1b9d-421d-900e-805890c23362 admin admin] Validating token access rules against request {{(pid=79897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:10:17.838104 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a33ed416d14d68b26b32e116862838', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f00ba0ca569547899fe0f1c352883756', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:10:17.838991 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:10:17.839331 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:10:17.839615 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] PATH_INFO: `/v3/projects/858f05d0f69741758c4c12930cc26a28` {{(pid=79897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:10:17.840831 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858f05d0f69741758c4c12930cc26a28)` {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:10:17.842800 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] RBAC: Authorization granted {{(pid=79897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:10:17.889144 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858f05d0f69741758c4c12930cc26a28', 'request_id': 'req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.895151 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858f05d0f69741758c4c12930cc26a28', 'request_id': 'req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.900445 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858f05d0f69741758c4c12930cc26a28', 'request_id': 'req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2'} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.911855 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] The token cache is being invalidate because project 858f05d0f69741758c4c12930cc26a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:10:17.912153 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.912776 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: DEBUG keystone.notifications [None req-2f9d3ab7-2edc-4666-b2ec-b1781d22c0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:10:17.914370 dv-cinder-841315-1-iscsi devstack@keystone.service[79897]: [pid: 79897|app: 0|req: 1465/2888] 10.222.0.57 () {58 vars in 1232 bytes} [Tue May 10 20:10:17 2022] DELETE /identity/v3/projects/858f05d0f69741758c4c12930cc26a28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:27.236882 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Authenticating user token {{(pid=79896) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.238289 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:27.305498 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91dd6-5899-451e-a639-38b744a638b5 admin admin] Validating token access rules against request {{(pid=79896) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.363205 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '722cc57a4637431686105db8181fdd0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95e34f16a16e4e82bb78ee2313e9a3e6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79896) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.363338 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] REQUEST_METHOD: `GET` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.363596 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] SCRIPT_NAME: `/identity` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.363812 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79896) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.365583 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.fernet_utils [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79896) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:27.377463 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.379287 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f21bb-c70f-4d67-b56c-7957b194faa0 service placement] RBAC: Authorization granted {{(pid=79896) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.389833 dv-cinder-841315-1-iscsi devstack@keystone.service[79896]: [pid: 79896|app: 0|req: 1424/2889] 10.222.0.57 () {60 vars in 1365 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)